LobeChat is an open-source, high-performance chatbot framework
that supports speech synthesis, multimodal, and extensible (Function Call) plugin system.
Supports one-click free deployment of your private ChatGPT/LLM web application.
English · 简体中文 · Changelog · Wiki · Report Bug · Request Feature
Share LobeChat Repository
Pioneering the new age of thinking and creating. Built for you, the Super Individual.
Table of contents
- 👋🏻 Getting Started & Join Our Community
- ✨ Features
- ⚡️ Performance
- 🛳 Self Hosting
- 📦 Ecosystem
- 🧩 Plugins
- ⌨️ Local Development
- 🤝 Contributing
- 🩷 Sponsor
- 🔗 More Products
Please be aware that LobeChat is currently under active development, and feedback is welcome for any issues encountered.
Important
Star Us, You will receive all release notifications from GitHub without any delay ~ ⭐️
Star History
LobeChat now supports OpenAI's latest gpt-4-vision model with visual recognition capabilities,
a multimodal intelligence that can perceive visuals. Users can easily upload or drag and drop images into the dialogue box,
and the agent will be able to recognize the content of the images and engage in intelligent conversation based on this,
creating smarter and more diversified chat scenarios.
This feature opens up new interactive methods, allowing communication to transcend text and include a wealth of visual elements. Whether it's sharing images in daily use or interpreting images within specific industries, the agent provides an outstanding conversational experience.
LobeChat supports Text-to-Speech (TTS) and Speech-to-Text (STT) technologies, enabling our application to convert text messages into clear voice outputs, allowing users to interact with our conversational agent as if they were talking to a real person. Users can choose from a variety of voices to pair with the agent.
Moreover, TTS offers an excellent solution for those who prefer auditory learning or desire to receive information while busy. In LobeChat, we have meticulously selected a range of high-quality voice options (OpenAI Audio, Microsoft Edge Speech) to meet the needs of users from different regions and cultural backgrounds. Users can choose the voice that suits their personal preferences or specific scenarios, resulting in a personalized communication experience.
Note
In the process of implementing this feature, we found that there was no satisfactory TTS (Text-to-Speech) frontend library available on the market. As a result, we invested a lot of effort, including data conversion, audio progress management, and speech visualization, among other tasks.
Important
Therefore, we decided to refine our implementation and make it open source, hoping to assist developers who wish to implement TTS. @lobehub/tts is a high-quality TTS toolkit developed in TypeScript, which supports usage both on the server-side and in the browser.
- Server-side: With just 15 lines of code, you can achieve high-quality voice generation capabilities comparable to OpenAI's TTS service. It currently supports EdgeSpeechTTS, MicrosoftTTS, OpenAITTS, and OpenAISTT.
- Browser-side: It provides high-quality React Hooks and visual audio components, supporting common functions such as loading, playing, pausing, and dragging the timeline. Additionally, it offers a very rich set of capabilities for adjusting the audio track styles.
The plugin ecosystem of LobeChat is a significant extension of its core functionalities, greatly enhancing the practicality and flexibility of ChatGPT. By leveraging plugins, ChatGPT can perform real-time information retrieval and processing, such as automatically fetching the latest news headlines to provide users with immediate and relevant information. Moreover, these plugins are not limited to news aggregation but can also extend to other practical functions, such as quick document retrieval, e-commerce platform data access, and various third-party services.
Plugin-Demo.mp4
Tip
To aid developers in joining this ecosystem, we provide comprehensive development resources in the 🧩 Plugin System section. This includes detailed component development documentation, a fully-featured software development kit (SDK), and template files—all designed to simplify the development process and lower the barrier to entry for developers.
Important
We welcome developers to use these resources to unleash their creativity and write feature-rich, user-friendly plugins. With collective efforts, we can continuously expand the boundaries of chat applications and explore a more intelligent and efficient creativity platform.
| Recent Submits | Repository | Description |
|---|---|---|
| weather GPT By Steven Tey on undefined |
steven-tey/weathergpt | Get current weather information for a specific location.weather |
| Ask Your PDF By AskYourPDF on undefined |
undefined | Unlock the power of your PDFs!, dive into your documents, find answers, and bring information to your fingertips.pdf document web |
| Clock Time By LobeHub on undefined |
lobehub/chat-plugin-clock-time | Display a clock to show current timeclock time |
| Pollinate drawing By AI0x0 on undefined |
mushan0x0/lobe-pollinations-ai | Generate images through pollinations.aidrawing image |
| Realtime Weather By LobeHub on undefined |
lobehub/chat-plugin-realtime-weather | Get realtime weather informationweather realtime |
| Search Engine By LobeHub on undefined |
lobehub/chat-plugin-search-engine | Query search engine to get informationweb search |
| SEO By Orren Prunckun on undefined |
undefined | Enter any URL and keyword and get an On-Page SEO analysis & insights!seo |
| Website Crawler By LobeHub on undefined |
lobehub/chat-plugin-web-crawler | Extract content from web linksweb content-crawler |
📊 Total plugins: 8
In the LobeChat Agent Marketplace, creators can discover a vibrant and innovative community that brings together a multitude of well-designed agents, which not only play an important role in work scenarios but also offer great convenience in learning processes. Our marketplace is not just a showcase platform but also a collaborative space. Here, everyone can contribute their wisdom and share the agents they have developed.
Tip
By 🤖/🏪 Submit Agents, you can easily submit your agent creations to our platform. Importantly, LobeChat has established a sophisticated automated internationalization (i18n) workflow, capable of seamlessly translating your agent into multiple language versions. This means that no matter what language your users speak, they can experience your agent without barriers.
Important
We welcome all users to join this growing ecosystem and participate in the iteration and optimization of agents. Together, we can create more interesting, practical, and innovative agents, further enriching the diversity and practicality of the agent offerings.
| Recent Submits | Description |
|---|---|
| Simulated ChatGPT Web By pzcn on 2023-12-16 |
Make GPT think it's the ChatGPT web version, thus achieving responses closer to the web version.assistant conversation |
| Greeting By almaziphone on 2023-12-16 |
Compose a beautiful and brief greeting with emojisgreeting celebration kind |
| Criminal Defense Expert By SuperLande on 2023-12-16 |
A Chinese criminal law expert who has been engaged in criminal defense practice for many years and understands the theory of criminal law and criminal procedure lawcriminal-defense |
| ShortBookGPT By thelapyae on 2023-12-15 |
Specializes in generating concise book summaries with actionable takeaways.book-summaries ai-assistant bullet-point-summaries actionable-takeaways |
📊 Total agents: 72
We deeply understand the importance of providing a seamless experience for users in today's multi-device environment. Therefore, we have adopted Progressive Web Application (PWA) technology, a modern web technology that elevates web applications to an experience close to that of native apps.
Through PWA, LobeChat can offer a highly optimized user experience on both desktop and mobile devices while maintaining its lightweight and high-performance characteristics. Visually and in terms of feel, we have also meticulously designed the interface to ensure it is indistinguishable from native apps, providing smooth animations, responsive layouts, and adapting to different device screen resolutions.
Note
If you are unfamiliar with the installation process of PWA, you can add LobeChat as your desktop application (also applicable to mobile devices) by following these steps:
- Launch the Chrome or Edge browser on your computer.
- Visit the LobeChat webpage.
- In the upper right corner of the address bar, click on the Install icon.
- Follow the instructions on the screen to complete the PWA Installation.
We have carried out a series of optimization designs for mobile devices to enhance the user's mobile experience. Currently, we are iterating on the mobile user experience to achieve smoother and more intuitive interactions. If you have any suggestions or ideas, we welcome you to provide feedback through GitHub Issues or Pull Requests.
As a design-engineering-oriented application, LobeChat places great emphasis on users' personalized experiences, hence introducing flexible and diverse theme modes, including a light mode for daytime and a dark mode for nighttime. Beyond switching theme modes, a range of color customization options allow users to adjust the application's theme colors according to their preferences. Whether it's a desire for a sober dark blue, a lively peach pink, or a professional gray-white, users can find their style of color choices in LobeChat.
Tip
The default configuration can intelligently recognize the user's system color mode and automatically switch themes to ensure a consistent visual experience with the operating system. For users who like to manually control details, LobeChat also offers intuitive setting options and a choice between chat bubble mode and document mode for conversation scenarios.








