I'm Jahanzeb Naeem, an AI/ML engineer with 3.5+ years of industry experience and a crazy passion for all things LLMs. This place is where I post some of my cool projects. If you like what I'm doing and want to partner up on something, hit me up!
Pinned Loading
-
budgeted_model_routing
budgeted_model_routing PublicInference-time scaling - if we can only afford to use the big model on some questions, can a simple rule pick which ones and beat just picking randomly?
Python
-
budgeted_eval_test
budgeted_eval_test PublicIf you can only afford a few expensive evaluations, should you spend them on the cases where your cheap evaluators disagree?
Python
-
rag_corruption_test
rag_corruption_test PublicHow does RAG answer reliability change as supporting evidence is progressively removed or replaced with distractor evidence?
Python
-
SignChatter
SignChatter PublicAn AI-based ASL and PSL translation tool available via a mobile app and website
Jupyter Notebook 1
-
-
hold-the-line
hold-the-line Publichow often does a model change its correct answer to a wrong one after pushback
Python
If the problem persists, check the GitHub status page or contact support.