Skip to content
Abelo9996Public

About

TableSage turns any CSV into an instant exploratory data analysis and lightweight modeling workspace. Upload a dataset and get cleaning suggestions, schema understanding, statistical insights, and sketch ML models (classification/regression) - all with interpretable explanations.

Resources

Stars

0 stars

Watchers

0 watching

Forks

Latest commit

 

History

2 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 
 
 
 
 

Repository files navigation

TableSage 🧙‍♂️

An AI Data Scientist for CSV Files

TableSage is an intelligent data analysis platform that automatically profiles, cleans, and builds ML models from CSV files. Upload your data and get instant insights, cleaning recommendations, automated ML models, and conversational data exploration.


Features

✨ Automatic Data Profiling - Comprehensive statistics, correlations, and distributions
🧹 Smart Cleaning Suggestions - Detect missing values, outliers, dtype issues
🤖 LLM Schema Inference - Semantic understanding of your columns
📊 Automated ML Models - Classification and regression with performance metrics
💬 Chat Interface - Ask questions about your data in natural language
📈 Interactive Visualizations - Charts and plots for deeper insights


Tech Stack

Backend

  • FastAPI - Modern, fast web framework
  • Pandas - Data manipulation and analysis
  • scikit-learn - Machine learning models
  • SHAP - Model explainability
  • Pydantic - Data validation

Frontend

  • React + TypeScript - Type-safe UI components
  • TailwindCSS - Modern styling
  • React Query - State management and API integration
  • Recharts - Data visualization

Quick Start

Prerequisites

  • Python 3.9+
  • Node.js 16+
  • npm or yarn

Backend Setup

# Navigate to backend directory
cd backend

# Create virtual environment
python -m venv venv
source venv/bin/activate  # On Windows: venv\Scripts\activate

# Install dependencies
pip install -r requirements.txt

# Run the server
uvicorn app.main:app --reload --host 0.0.0.0 --port 8000

Backend will be available at: http://localhost:8000
API Documentation: http://localhost:8000/docs

Frontend Setup

# Navigate to frontend directory
cd frontend

# Install dependencies
npm install

# Start development server
npm run dev

Frontend will be available at: http://localhost:5173


Project Structure

TableSage/
├── backend/
│   ├── app/
│   │   ├── __init__.py
│   │   ├── main.py              # FastAPI server & endpoints
│   │   ├── eda.py               # Exploratory data analysis
│   │   ├── cleaning.py          # Data cleaning suggestions
│   │   ├── modeling.py          # ML model training
│   │   ├── llm.py               # LLM integration placeholders
│   │   ├── schemas.py           # Pydantic models
│   │   └── utils.py             # Helper functions
│   ├── tests/
│   │   └── test_api.py
│   ├── uploads/                 # Temporary CSV storage
│   ├── requirements.txt
│   └── README.md
├── frontend/
│   ├── src/
│   │   ├── components/          # React components
│   │   ├── pages/               # Page components
│   │   ├── services/            # API integration
│   │   ├── types/               # TypeScript types
│   │   ├── App.tsx
│   │   └── main.tsx
│   ├── package.json
│   └── tailwind.config.js
├── sample_data/
│   └── example.csv              # Sample dataset
└── README.md

API Endpoints

Upload & Profile

  • POST /upload - Upload CSV file and get initial metadata
  • GET /profile/{dataset_id} - Get comprehensive profiling results

Data Quality

  • GET /cleaning_suggestions/{dataset_id} - Get cleaning recommendations

Schema & Insights

  • GET /schema_llm/{dataset_id} - LLM-inferred column semantics

Machine Learning

  • POST /train_model - Train classification or regression models
  • GET /model_results/{dataset_id} - Get model performance metrics

Chat Interface

  • POST /chat - Ask natural language questions about your data

Usage Example

  1. Upload CSV

    curl -X POST "http://localhost:8000/upload" \
      -F "file=@your_data.csv"
  2. Get Profiling Results

    curl "http://localhost:8000/profile/dataset_123"
  3. Train Model

    curl -X POST "http://localhost:8000/train_model" \
      -H "Content-Type: application/json" \
      -d '{"dataset_id": "dataset_123", "target_column": "price"}'

Development

Running Tests

# Backend tests
cd backend
pytest tests/

# Frontend tests
cd frontend
npm test

Code Formatting

# Backend
black app/
isort app/

# Frontend
npm run lint
npm run format

Roadmap

v0.1 (Current)

  • CSV upload and storage
  • Basic profiling and statistics
  • Cleaning suggestions
  • Baseline ML models
  • React frontend

v0.2 (Planned)

  • LLM integration (OpenAI/Anthropic)
  • Advanced visualizations
  • Data transformation UI
  • Model export

v0.3 (Future)

  • Multi-file analysis
  • SQL database support
  • Custom model training
  • Collaboration features

Contributing

Contributions are welcome! Please feel free to submit a Pull Request.


License

MIT License - see LICENSE file for details


Support

For issues or questions, please open an issue on GitHub.


Built with ❤️ for data scientists and analysts

About

TableSage turns any CSV into an instant exploratory data analysis and lightweight modeling workspace. Upload a dataset and get cleaning suggestions, schema understanding, statistical insights, and sketch ML models (classification/regression) - all with interpretable explanations.

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages