Repository navigation
Open
Labels
databaseDatabase schema, migrations, and data integrityDatabase schema, migrations, and data integrityenhancementNew feature or requestNew feature or requestpriority:mediumMedium priority - important but not urgentMedium priority - important but not urgent
Description
Description
Integrate SeaLifeBase as an additional external data source to complement FishBase coverage. SeaLifeBase covers non-fish marine organisms that FishBase doesn't include.
Background
SeaLifeBase is the marine organism companion to FishBase:
- Covers corals, inverts, and other marine life
- Same team/infrastructure as FishBase
- Available as DuckDB/Parquet files (similar to FishBase)
- Fills gaps in our current coverage
Data Available
- Species descriptions and taxonomy
- Images and illustrations
- Habitat and distribution data
- Conservation status
- Common names
Implementation Approach
Follow the same pattern as FishBase integration:
- Download SeaLifeBase data (DuckDB/Parquet format)
- Create integration client: `src/integrations/sealifebase.ts`
- Create sync script: `scripts/sync-sealifebase-all-species.ts`
- Add to orchestrator: Update `sync-all-species-full-database.ts`
Code Structure
// src/integrations/sealifebase.ts
export interface SeaLifeBaseResult {
found: boolean;
species_url?: string;
images?: Array<{
url: string;
caption?: string;
}>;
}
export async function getExternalData(
genus: string,
species: string
): Promise<SeaLifeBaseResult> {
// Query SeaLifeBase DuckDB for species data
// Return URLs and images
}Tasks
- Research SeaLifeBase data availability and format
- Download SeaLifeBase Parquet files
- Create `src/integrations/sealifebase.ts` client
- Create `scripts/sync-sealifebase-all-species.ts` sync script
- Add SeaLifeBase to master orchestrator
- Test with coral and invert species
- Update documentation (wiki + README)
Acceptance Criteria
- SeaLifeBase client successfully queries local DuckDB
- Sync script processes coral/invert species
- Images downloaded to R2 with proper attribution
- External references stored in database
- No duplicate data with existing sources
- Documentation updated
Priority
Medium - Improves coverage for non-fish species.
Related to #240 (External Data Sources Integration)
Metadata
Metadata
Assignees
Labels
databaseDatabase schema, migrations, and data integrityDatabase schema, migrations, and data integrityenhancementNew feature or requestNew feature or requestpriority:mediumMedium priority - important but not urgentMedium priority - important but not urgent
Activity