[go: up one dir, main page]

Skip to content
You must be logged in to sponsor fkodom
Become a sponsor to Frank Odom
@fkodom

Frank Odom

fkodom
Huntsville, AL

Your sponsorship helps to support open-source artificial intelligence research. My recent work focuses on efficient Transformer-based architectures, especially for NLP, CV, and self-driving. All of this comes from my personal time, and is released under permissive licenses (e.g. MIT).

If you have benefited from my projects, please consider becoming a sponsor.

1 sponsor has funded fkodom’s work.

@fkodom

Gain an initial support base of repeat monthly sponsors.

@lucidrains

Featured work

  1. fkodom/fft-conv-pytorch

    Implementation of 1D, 2D, and 3D FFT convolutions in PyTorch. Much faster than direct convolutions for large kernel sizes.

    Python 476
  2. fkodom/transformer-from-scratch

    Code implementation from my blog post: https://fkodom.substack.com/p/transformers-from-scratch-in-pytorch

    Python 90
  3. fkodom/yet-another-retnet

    A simple but robust PyTorch implementation of RetNet from "Retentive Network: A Successor to Transformer for Large Language Models" (https://arxiv.org/pdf/2307.08621.pdf)

    Python 100
  4. fkodom/clip-text-decoder

    Generate text captions for images from their embeddings.

    Python 101
  5. fkodom/dilated-attention-pytorch

    (Unofficial) Implementation of dilated attention from "LongNet: Scaling Transformers to 1,000,000,000 Tokens" (https://arxiv.org/abs/2307.02486)

    Python 50

0% towards 10 monthly sponsors goal

Be the first to sponsor this goal!

Select a tier

$ a month

You'll receive any rewards listed in the $5 monthly tier. Additionally, a Public Sponsor achievement will be added to your profile.

$5 a month

Select

Basic

  • Get a Sponsor badge on your profile
  • Free paid subscription to my blog (fkodom.substack.com)

$25 a month

Select

Platinum

  • Logo or name goes in my project README
  • Shoutout on LinkedIn, or platform of your choice
  • Everything in $5/month tier

$100 a month

Select

Hero 🦸

  • Will consider naming my next child after you (no promises 😉)