8000 GitHub - Dominic789654/Dominic789654: GitHub profile README for Xiang Liu, summarizing research on efficient LLM inference, long context, KV cache, and agent systems. · GitHub
[go: up one dir, main page]

Skip to content
7FFF

About

GitHub profile README for Xiang Liu, summarizing research on efficient LLM inference, long context, KV cache, and agent systems.

Topics

Resources

Stars

0 stars

Watchers

0 watching

Forks

Latest commit

 

History

8 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 

Repository files navigation

Xiang Liu - Efficient LLM Inference and Agent Systems

Homepage Google Scholar X

Ph.D. student @ HKUST(GZ)
Efficient and reliable LLMs: inference, long context, KV cache, retrieval, and agentic workflows.


400+ stars
across 50 original repositories
3.6k commits · 560+ PRs
past year, public activity
benchmark → method → artifact
how I like research to ship

Current Focus

Inference efficiency
KV-cache compression, token-efficient reasoning, energy-to-token evaluation, serving bottlenecks.
Long-context evaluation
Generation-focused benchmarks, dense reasoning integrity, multi-turn coherence.
Agent systems
Tool use, post-training, harness design, local-first agent workflow infrastructure.
Research infrastructure
Reproducible artifacts, project pages, scholar tracking, figure and report tooling.

Selected Work

Long-context generation benchmark for coherent, context-aware long-form responses — the gap left open by extractive needle-in-a-haystack tests.

stars paper Python

Policy-conditioned live-market evaluation for LLM trading agents. Benchmark the policy, not just the model.

stars agent eval Python

Position paper project page: LLM inference should be evaluated as energy-to-token production, not tokens per second alone.

HTML serving

Local-first agent task hub: SQLite queueing, dependency-aware dispatch, templates, pipelines, and a thin dashboard.

stars SQLite

Adapters between XML-like tool calls and OpenAI-style structured tool-call histories — for post-training and eval harnesses.

Python tool use

Tooling for publication-grade scientific figures — reproducible, paper-ready plots without the last-minute scramble.

stars Python figures

Upstream Contributions

Merged PRs into other people's projects — 29 outside my own repositories.

LMFlow · 8.5k★

15 merged PRs — LISA (reasoning-aware fine-tuning), DoRA and Hymba support, LoRA target-module fixes, eval-during-training, large-data preprocessing.

kvpress · 1.2k★

Merged add ChunkKV — chunk-wise KV-cache compression for long-context inference.

Ecosystem lists & tooling

Merged into awesome-vibe-coding (5.3k★), posterly (411★), alpaca_eval (2k★), Prompt-Engineering-Guide.

Open Source & Community

The tooling layer around agent research — mostly reusable skills and curated indexes.

A curated list of plugins, skills, MCP servers, patch/profile layers, orchestrators & UIs for DeepSeek Harness (DSH).

awesome dsh stars

Agent skills

auto-research · auto-kernel-research · EvoHarness.skills
critical-reviewer-skill (3★) · openspec-grillme (3★)
kimi-code-skills · qwen-code-skills · claude-code-skills

Autonomous research loops, kernel optimization, academic review, spec-driven development, model-specific delegators.

Evaluation & infra

llm_benchmark_eval · llm-benchmark-research
agentic-dataset-builder · model-case-repros
scholar_tracker · KimiQuota

Writing & artifacts

ai-semiconductor-bottleneck-atlas
llm-inference-tutorials · Paper-List
Reading-note · WeLM-blog

Web decks, reading notes, and project pages for papers.

Research Map

long-context generation ──┬── LongGenBench
                          ├── semantic integrity under KV compression
                          └── multi-turn coherence / FlowKV

agent capability eval ────┬── QuantArena
                          ├── tool-use adapters
                          └── local-first agent workflow runtime

efficient inference ──────┬── ChunkKV / KV compression
                          ├── token-efficient reasoning
                          └── energy-to-token production

research tooling ─────────┬── benchmark & dataset builders
                          ├── figure / report / poster pipelines
                          └── agent skill ecosystem (DSH, Codex, Claude)

Stack

Python PyTorch TypeScript React SQLite LaTeX

GitHub stats Top languages

repositories · publications · citations

About

GitHub profile README for Xiang Liu, summarizing research on efficient LLM inference, long context, KV cache, and agent systems.

Topics

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

0