An AI-enhanced data processing and task optimization platform
Transform your raw data into actionable insights with intelligent validation, natural language search, and AI-powered business rules.
- Multi-format Import: Support for CSV, Excel (.xlsx, .xls) with intelligent column mapping
- Real-time Validation: Advanced data validation with error detection and suggestions
- Inline Editing: Spreadsheet-like editing experience with change tracking
- Export Options: Multiple export formats including JSON, CSV, and Excel
- Natural Language Search: Query your data using plain English
- Smart Column Mapping: AI-assisted column mapping with confidence scoring
- Business Rule Generation: AI-powered rule creation and optimization
- Data Insights: Automated analysis and recommendations
- Dynamic Business Rules: Create, edit, and manage complex business logic
- Priority Scoring: Configurable priority profiles with weight-based calculations
- Interactive Dashboards: Real-time data visualization and monitoring
- Change Tracking: Complete audit trail with save/discard functionality
- Modern UI: Clean, responsive design with dark/light theme support
- Intuitive Navigation: Step-by-step workflow with progress tracking
- Real-time Feedback: Instant validation and visual indicators
- Accessibility: Full keyboard navigation and screen reader support
- Node.js 18.0 or higher
- npm, yarn, pnpm, or bun
- Gemini API Key (optional, for AI features)
-
Clone the repository
git clone <repository-url> cd data-alchemist
-
Install dependencies
npm install # or yarn install # or pnpm install # or bun install
-
Set up environment variables
cp .env.example .env.local
Edit
.env.localand add your Gemini API key:GEMINI_API_KEY=your_gemini_api_key_here NEXT_PUBLIC_GEMINI_API_KEY=your_gemini_api_key_here
-
Start the development server
npm run dev # or yarn dev # or pnpm dev # or bun dev
-
Open your browser Navigate to http://localhost:3000
- Navigate to the Upload page
- Upload your CSV or Excel files for Clients, Workers, and Tasks
- Use AI-assisted column mapping for mismatched headers
- Review validation results and fix any errors
- View comprehensive validation reports
- Edit data inline with spreadsheet-like functionality
- Add/remove rows with full validation
- Track changes with save/discard options
- Use plain English queries: "Show high priority clients"
- Filter data dynamically with AI-powered search
- Export filtered results in multiple formats
- Create custom business logic with the rule builder
- Use AI assistance for rule generation from natural language
- Test rules with preview functionality
- Manage rule priority and activation status
- Choose from pre-built priority profiles:
- Maximize Fulfillment: Optimize for completion rates
- Fair Distribution: Balance workload across workers
- Revenue Focused: Prioritize high-value tasks
- Custom: Create your own weighting system
- Export processed data in multiple formats
- Download generated business rules
- API-ready JSON output for system integration
| Variable | Description | Required |
|---|---|---|
GEMINI_API_KEY |
Gemini 2.0 Flash API key for AI features | Yes |
NEXT_PUBLIC_GEMINI_API_KEY |
Public Gemini API key (fallback) | Yes |
DATABASE_URL |
Database connection string (future use) | No |
-
Get Gemini API Key:
- Visit Google AI Studio
- Create a new API key
- Add it to your
.env.localfile
-
AI Features Available:
- ✅ Natural language search
- ✅ Smart column mapping
- ✅ Business rule generation
- ✅ Data validation assistance
-
Fallback Mode:
- App works without API key using mock responses
- Full functionality available with limited AI features
data-alchemist/
├── 📁 src/
│ ├── 📁 app/ # Next.js App Router pages
│ │ ├── 📁 upload/ # Data upload interface
│ │ ├── 📁 rules/ # Business rules management
│ │ ├── 📁 export/ # Data export functionality
│ │ └── 📁 api/ # API routes (AI integration)
│ ├── 📁 components/ # React components
│ │ ├── 📁 ui/ # Reusable UI components (shadcn/ui)
│ │ ├── NaturalLanguageSearch.tsx
│ │ ├── EditableDataGrid.tsx
│ │ ├── BusinessRuleBuilder.tsx
│ │ └── ...
│ ├── 📁 lib/ # Utilities and configurations
│ │ ├── stores.ts # Zustand state management
│ │ ├── ai.ts # AI service integration
│ │ ├── validation.ts # Data validation logic
│ │ └── schemas.ts # Data type definitions
│ ├── 📁 utils/ # Helper functions
│ └── 📁 types/ # TypeScript type definitions
├── 📄 package.json
├── 📄 tailwind.config.ts
├── 📄 next.config.js
└── 📄 README.md
- Next.js 15.4.6 - React framework with App Router
- React 19.1.0 - UI library with latest features
- TypeScript 5.x - Type-safe development
- Tailwind CSS 4.x - Utility-first styling
- shadcn/ui - Modern component library
- Radix UI - Headless UI primitives
- Lucide React - Beautiful icons
- Sonner - Toast notifications
- PapaParse - CSV parsing
- XLSX - Excel file processing
- Zod - Runtime type validation
- TanStack Table - Data grid functionality
- Zustand - Lightweight state management
- Local Storage Persistence - Data persistence across sessions
- Gemini 2.0 Flash - Google's latest AI model
- LangChain - AI application framework
- Natural Language Processing - Query understanding and processing
- Primary: Modern blue gradient (
from-blue-500 to-purple-600) - Secondary: Clean grays with excellent contrast
- Accent: Purple highlights for interactive elements
- Status Colors: Semantic colors for validation states
- Font Family: Geist Sans - Optimized for readability
- Font Sizes: Carefully scaled type system
- Font Weights: Strategic emphasis hierarchy
- ✅ Consistent cursor-pointer on all clickable elements
- ✅ Hover states with smooth transitions
- ✅ Focus management for accessibility
- ✅ Loading states and progress indicators
- ⚡ Turbopack: Lightning-fast development builds
- 🎯 Code Splitting: Automatic route-based splitting
- 🗜️ Bundle Optimization: Tree-shaking and compression
- 📱 Responsive Design: Mobile-first approach
- ♿ Accessibility: WCAG 2.1 AA compliance
- 🛡️ Client-Side Processing: Sensitive data never leaves your browser
- 🔒 Secure API Calls: Encrypted communication with AI services
- 💾 Local Storage: Data persisted locally with encryption options
- 🗂️ No Data Collection: Your data stays private
# Production environment variables
GEMINI_API_KEY=your_production_api_key
NEXT_PUBLIC_GEMINI_API_KEY=your_production_api_key
NODE_ENV=productionThis project is licensed under the MIT License - see the LICENSE file for details.
Built with ❤️ using cutting-edge web technologies
Transform your data processing workflow with AI-powered intelligence