Collector uses Bitsamp as a datasource, gathers market data.
###Collecting:
- Timestamp
- Price
- Amount
- type (sell or buy)
- Top 20 bids
- Top 20 asks
- Daily High
- Daily Low
- Daily Volume
- Daily Volume Weighted Average Price
for each trade.
- Clone repository
- Create a virtualenv, preferably
- Install requirements
- Install Postgres
- Install Python packages
pip install --upgrade -r requirements.txt
- Create a
secret.envfor secret keys and configurationDATABASE_URL, should look like thispostgres://<USER>:<PASSWORD>@127.0.0.1:5432/<DB_NAME>- AWS Environment variables
Just run python dataset/collector.py
Logs will be available in same directory as colector.log
Dataset will be available in June (after collecting 4-5 months worth data)
Collected data is stored in Postgres. When finished collecting, data will be migrated to InfluxDB for nice time-series query capabilities
- Adding a new datasource / digital currency worth collecting
- Fixing docs / bugs etc.
Check LICENSE