8000 Add SeaLifeBase Integration · Issue #251 · jra3/mulm · GitHub
[go: up one dir, main page]

Skip to content

Add SeaLifeBase Integration #251

Open

Description

@jra3

Description

Integrate SeaLifeBase as an additional external data source to complement FishBase coverage. SeaLifeBase covers non-fish marine organisms that FishBase doesn't include.

Background

SeaLifeBase is the marine organism companion to FishBase:

  • Covers corals, inverts, and other marine life
  • Same team/infrastructure as FishBase
  • Available as DuckDB/Parquet files (similar to FishBase)
  • Fills gaps in our current coverage

Data Available

  • Species descriptions and taxonomy
  • Images and illustrations
  • Habitat and distribution data
  • Conservation status
  • Common names

Implementation Approach

Follow the same pattern as FishBase integration:

  1. Download SeaLifeBase data (DuckDB/Parquet format)
  2. Create integration client: `src/integrations/sealifebase.ts`
  3. Create sync script: `scripts/sync-sealifebase-all-species.ts`
  4. Add to orchestrator: Update `sync-all-species-full-database.ts`

Code Structure

// src/integrations/sealifebase.ts
export interface SeaLifeBaseResult {
  found: boolean;
  species_url?: string;
  images?: Array<{
    url: string;
    caption?: string;
  }>;
}

export async function getExternalData(
  genus: string,
  species: string
): Promise<SeaLifeBaseResult> {
  // Query SeaLifeBase DuckDB for species data
  // Return URLs and images
}

Tasks

  • Research SeaLifeBase data availability and format
  • Download SeaLifeBase Parquet files
  • Create `src/integrations/sealifebase.ts` client
  • Create `scripts/sync-sealifebase-all-species.ts` sync script
  • Add SeaLifeBase to master orchestrator
  • Test with coral and invert species
  • Update documentation (wiki + README)

Acceptance Criteria

  • SeaLifeBase client successfully queries local DuckDB
  • Sync script processes coral/invert species
  • Images downloaded to R2 with proper attribution
  • External references stored in database
  • No duplicate data with existing sources
  • Documentation updated

Priority

Medium - Improves coverage for non-fish species.

Related to #240 (External Data Sources Integration)

Activity

  1. added
    enhancementNew feature or request
    databaseDatabase schema, migrations, and data integrity
    priority:mediumMedium priority - important but not urgent
    on Dec 13, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    databaseDatabase schema, migrations, and data integrityenhancementNew feature or requestpriority:mediumMedium priority - important but not urgent

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions

      0