Skip to content

Latest commit

 

History

History

automate-ml-for-kaggle

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
OAI_CONFIG_LIST_sample
OAI_CONFIG_LIST_sample
 
 
README.md
README.md
 
 
house_prices_train.csv
house_prices_train.csv
 
 
main.py
main.py
 
 
requirements.txt
requirements.txt
 
 
utils.py
utils.py
 
 

README.md

Automated Machine Learning Workflow

In this project, we build a machine learning workflow using AG2. The workflow involves data analysis, preprocessing, and model training to build a machine learning model.

Machine learning workflows typically involve several key steps:

  1. Data Analysis and Exploration: Understanding dataset size, columns, and distributions.
  2. Data Preprocessing: Cleaning data, handling missing values, and encoding categorical variables.
  3. Model Training: Training a model, comparing different models, and tuning hyperparameters.

Details

The workflow follows the steps of data analysis, preprocessing, and model training. Each step is executed by a specific agent, and the transition between steps is determined by the success or failure of the previous step.

We follow a state machine design to build the machine learning workflow:

  • Init and End: Represent the start and end of the workflow.
  • Explore: Analyze the dataset.
    • Agents: Data Explorer → Code Executor
    • Transition: If code execution is successful, move to Preprocess; otherwise, remain in Explore.
  • Preprocess: Clean and prepare data.
    • Agents: Data Preprocessor → Code Executor
    • Transition: A language model determines whether all necessary preprocessing steps have been completed. If yes, move to Train; otherwise, return to Explore for further analysis.
  • Train: Train a machine learning model.
    • Agents: Model Trainer → Code Executor
    • Transition: The model is trained in two iterations to compare performance. If the maximum trials are reached, move to Summarize. If code execution fails, remain in Train (failed trials do not count).
  • Summarize: Generate a summary of the workflow.
    • Agents: Summarizer
    • Transition: Always moves to End.

At the Explore, Preprocess, and Train states:

  • A language model agent is invoked first.
  • A code executor then executes the generated code.
  • If execution fails, the workflow remains in the same state.
  • If execution succeeds, conditions are checked to determine whether to transition to the next state.

This structured workflow ensures an efficient and iterative approach to machine learning model building.

AG2 Features

This project demonstrates the following AG2 features:

## TAGS

TAGS: data analysis, groupchat, stateflow, code execution, kaggle, automated machine learning, workflow automation, model training, data preprocessing, state machine, hyperparameter tuning

Installation

First, Clone and navigate to the folder:

git clone https://github.com/ag2ai/build-with-ag2.git
cd build-with-ag2/game_design_agent_team

Then install the required dependencies:

pip install -r requirements.txt

The dependency is ag2 with graphrag option.

Run the code

Before running the demo, you need to set up your OpenAI API configuration. Create a OAI_CONFIG_LIST file based on the provided OAI_CONFIG_LIST_sample and update the api_key to your OpenAI API key for the configuration with the tag "gpt-4o". Change filter_dict tags in main.py if you want to use other models. Refer to AutoGen configuration guide for more details.

cp OAI_CONFIG_LIST_sample OAI_CONFIG_LIST
python main.py

Contact

For more information or any questions, please refer to the documentation or reach out to us!

License

This project is licensed under the Apache License 2.0. See the LICENSE for details.