Gold-Digger is the ultimate cryptocurrency data mining bot that strikes digital gold for your ML applications! ๐ This Python powerhouse collects, processes, and stores crypto trading data with a focus on volume breakouts and technical patterns - perfect for training machine learning models to predict market movements.
- โ๏ธ Multi-Exchange Mining: Collects data from 6 major exchanges (Binance, Kraken, Crypto.com, OKX, Bitfinex, Coinbase)
- ๐ฐ Volume Breakout Detection: Advanced algorithms to identify volume jackpots and trading opportunities
- ๐ง ML-Ready Data: Pre-processed feature vectors and targets for supervised learning
- ๐ง Technical Arsenal: 15+ technical indicators (RSI, MACD, Bollinger Bands, etc.)
- ๐ฆ Secure Data Vault: SQLite database optimized for ML training workflows
- ๐ช Entertaining Logs: Funny mining-themed messages that make data collection enjoyable!
Gold-Digger specializes in identifying volume breakouts - those golden moments when trading volume explodes, often preceding significant price movements:
- 2x Volume Spikes: Early warning signals
- 3x Volume Explosions: Strong breakout candidates
- 5x Volume Jackpots: Rare mega-breakouts for premium opportunities
- Follow-through Analysis: Price impact tracking for breakout validation
Python 3.8+
pip package manager# Clone the golden repository
git clone https://github.com/xtoor/gold-digger.git
cd gold-digger
# Install dependencies
pip install pandas numpy sqlite3 requests ccxt ta schedule
# Configure your API keys (optional but recommended)
# Find this section in gold-digger.py and fill in the API info add or remove brokers by commenting out its block
# Edit the setup_mining_operations() function with your exchange API credentials
```code
self.log_funny("๐ง Setting up mining equipment across multiple exchanges...")
# Original exchanges
self.exchanges['coinbase'] = ccxt.coinbase({
'apiKey': '',
'secret': '',
'password': '',
'sandbox': False,
'rateLimit': 1000,
})
# New exchanges added per request
self.exchanges['kraken'] = ccxt.kraken({
'apiKey': '',
'secret': '',
'sandbox': False,
'rateLimit': 1000,
})
self.exchanges['cryptocom'] = ccxt.cryptocom({
'apiKey': '',
'secret': '',
'sandbox': False,
'rateLimit': 1000,
})
# Note: CCXT doesn't have direct Uphold support, using OKX as alternative
self.exchanges['okx'] = ccxt.okx({
'apiKey': '',
'secret': '',
'password': '',
'sandbox': False,
'rateLimit': 1000,
})
# Using Bitfinex as another major exchange option
self.exchanges['bitfinex'] = ccxt.bitfinex({
'apiKey': '',
'secret': '',
'sandbox': False,
'rateLimit': 1500,
})```
# Start mining!
python gold_digger.pypandas>=1.3.0
numpy>=1.21.0
requests>=2.25.0
ccxt>=4.0.0
ta>=0.10.0
schedule>=1.1.0
sqlite3 (built-in)from gold_digger import GoldDigger
# Initialize the mining rig
digger = GoldDigger()
# Launch full expedition (top 30 cryptos, 30 days history)
digger.launch_full_mining_expedition(top_n=30, days=30)
# Get ML training data
training_data = digger.get_ml_training_gold()
feature_vectors = digger.get_ml_features()import schedule
# Set up automated mining every 2 hours
schedule.every(2).hours.do(
lambda: digger.launch_full_mining_expedition(top_n=20, days=1)
)| Table | Purpose | Key Features |
|---|---|---|
gold_nuggets |
Main trading data | OHLCV + 20+ technical indicators |
volume_jackpots |
Breakout events | Volume multipliers, price impacts |
utility_treasure_map |
Fundamental metrics | GitHub activity, social buzz, dev metrics |
ml_feature_vault |
ML-ready vectors | JSON feature sets + targets |
SELECT symbol, timestamp, volume_breakout_score, rsi, macd
FROM gold_nuggets
WHERE volume_breakout_score > 70
ORDER BY timestamp DESC;The heart of Gold-Digger's intelligence:
# Volume Jackpot Scoring (0-100)
if volume > 5 * volume_ma_20:
score = 100 # MEGA JACKPOT! ๐ฐ
elif volume > 3 * volume_ma_20:
score = 85 # BIG JACKPOT! ๐ฐ
elif volume > 2 * volume_ma_20:
score = 70 # MINI JACKPOT! ๐ฏ
else:
score = volume_ratio * 40 # Building momentum...features = {
'price_momentum_5': recent_price_changes,
'volume_trend_10': volume_pattern_analysis,
'rsi_current': momentum_indicator,
'bb_position': volatility_position,
'volume_breakout_score': breakout_probability
}target_breakout_1h: Volume breakout in next hourtarget_breakout_24h: Volume breakout in next 24htarget_price_change_1h: Price movement correlationtarget_price_change_24h: Extended price impact
# Mine Bitcoin data for the last 7 days
digger = GoldDigger()
digger.strike_gold_for_symbol('BTC/USDT', days=7)# Find recent volume jackpots
jackpots = digger.detect_volume_jackpots(df, 'ETH/USDT')
for jackpot in jackpots:
print(f"๐ฅ {jackpot['symbol']} - {jackpot['jackpot_type']}")# Get processed features for model training
features_df = digger.get_ml_features(days=30)
X = features_df.drop(['target_breakout_1h'], axis=1)
y = features_df['target_breakout_1h']
# Train your model
from sklearn.ensemble import RandomForestClassifier
model = RandomForestClassifier()
model.fit(X, y)โ๏ธ Digging for digital gold in the crypto mines...
๐ GOLD-DIGGER EXPEDITION #1 LAUNCHED!
๐ฏ Target: Top 30 crypto veins, 30 days deep!
โญ Found 30 golden symbols ready for mining!
๐ฅ BOOM! Volume just went nuclear! โข๏ธ
๐ฆ Deposited 1440 golden nuggets! Vault total: 43200
๐ EXPEDITION COMPLETE! Success rate: 96.7%
๐ Total nuggets in vault: 43200
We welcome fellow gold miners!
- Fork the repository
- Create your feature branch (
git checkout -b feature/AmazingFeature) - Commit your changes (
git commit -m 'Add some AmazingFeature') - Push to the branch (
git push origin feature/AmazingFeature) - Open a Pull Request
| Exchange | Status | Volume Data | Real-time |
|---|---|---|---|
| Binance | โ | โ | โ |
| Kraken | โ | โ | โ |
| Crypto.com | โ | โ | โ |
| OKX | โ | โ | โ |
| Bitfinex | โ | โ | โ |
| Coinbase Pro | โ | โ | โ |
This tool is for educational and research purposes. Always do your own research before making trading decisions. Cryptocurrency trading involves substantial risk of loss.
This project is licensed under the MIT License - see the LICENSE file for details.
Made with ๐ฐ by crypto enthusiasts, for crypto enthusiasts
Strike digital gold with every data point! โ๏ธ๐
- ๐ Issues: GitHub Issues
- ๐ฌ Discussions: GitHub Discussions
- โญ Star this repo if Gold-Digger helps you strike it rich!
Happy Mining! ๐๐ฐ
