🎉 𝗠𝗮𝗷𝗼𝗿 𝗠𝗶𝗹𝗲𝘀𝘁𝗼𝗻𝗲 𝗔𝗹𝗲𝗿𝘁: 𝗭𝗵𝗶𝗵𝘂 𝗵𝗮𝘀 𝘀𝘂𝗰𝗰𝗲𝘀𝘀𝗳𝘂𝗹𝗹𝘆 𝗱𝗲𝗽𝗹𝗼𝘆𝗲𝗱 𝗔𝗽𝗮𝗰𝗵𝗲 𝗚𝗹𝘂𝘁𝗲𝗻 𝗶𝗻 𝗽𝗿𝗼𝗱𝘂𝗰𝘁𝗶𝗼𝗻! They have completed 𝟳𝟲.𝟰𝟯% 𝗼𝗳 𝘁𝗵𝗲𝗶𝗿 𝘄𝗼𝗿𝗸𝗹𝗼𝗮𝗱 𝗺𝗶𝗴𝗿𝗮𝘁𝗶𝗼𝗻 and achieved an impressive 𝟰𝟰.𝟲𝟰% 𝗿𝗲𝗱𝘂𝗰𝘁𝗶𝗼𝗻 𝗶𝗻 𝗰𝗼𝗺𝗽𝘂𝘁𝗲 𝗿𝗲𝘀𝗼𝘂𝗿𝗰𝗲𝘀. It’s incredibly rewarding to see Gluten delivering this level of real-world impact in large‑scale Spark environments. Zhihu’s journey is a perfect testament to 𝗵𝗼𝘄 𝗚𝗹𝘂𝘁𝗲𝗻 𝗵𝗮𝘀 𝘀𝘁𝗲𝗮𝗱𝗶𝗹𝘆 𝗺𝗮𝘁𝘂𝗿𝗲𝗱 over the years: ● 🗓️ 𝟮𝟬𝟮𝟯: Zhihu first evaluated Gluten. They saw improvements, but it wasn't quite ready for their massive scale, so the project was paused. ● 📈 𝗤𝟭 𝟮𝟬𝟮𝟱: They restarted Spark‑to‑Gluten migration tests, hitting up to 40% resource savings! However, a few complex jobs still needed fine-tuning for full production maturity. ● 🚀 𝗤𝟭 𝟮𝟬𝟮𝟲: They relaunched the project—and absolutely nailed the incredible results above. Just as importantly, this deployment highlights exactly 𝗵𝗼𝘄 𝗼𝗽𝗲𝗻-𝘀𝗼𝘂𝗿𝗰𝗲 𝗰𝗼𝗹𝗹𝗮𝗯𝗼𝗿𝗮𝘁𝗶𝗼𝗻 𝗱𝗿𝗶𝘃𝗲𝘀 𝗽𝗿𝗼𝗱𝘂𝗰𝘁 𝗺𝗮𝘁𝘂𝗿𝗶𝘁𝘆. During the rollout, the Zhihu team identified 13 specific areas for improvement across data correctness, performance, and stability—and actively contributed PRs to fix them. 🛠️ This is the true power of community. Gluten is where it is today thanks to the relentless contributions from users and developers alike. 💡 𝗧𝗵𝗲 𝗧𝗮𝗸𝗲𝗮𝘄𝗮𝘆: If you tested Gluten in the past and didn’t quite get the results you needed, 𝗻𝗼𝘄 𝗶𝘀 𝘁𝗵𝗲 𝗽𝗲𝗿𝗳𝗲𝗰𝘁 𝘁𝗶𝗺𝗲 𝘁𝗼 𝘁𝗿𝘆 𝗮𝗴𝗮𝗶𝗻. If you run into issues, we’re here to help! The community is highly active on GitHub, LinkedIn, Slack, and WeChat. Come join the conversation! https://lnkd.in/gW8zKcJk
Apache Gluten
Data Infrastructure and Analytics
Apache Gluten is the middle layer responsible for offloading JVM-based SQL engine execution to native engines.
About us
mail list: dev@gluten.apache.org Slack invitation link: https://join.slack.com/t/the-asf/shared_invite/zt-30482kx86-Y6cCySjb5Tvc6~~iAIGyVQ Wechat group (Chinese): contact weitingchen@apache.org to get invited
- Website
-
https://gluten.apache.org/
External link for Apache Gluten
- Industry
- Data Infrastructure and Analytics
- Company size
- 2-10 employees
- Type
- Nonprofit
Updates
-
Apache Gluten reposted this
Drumroll please.... 🥁 Announcing the #VeloxCon 2026 agenda, now live! https://lnkd.in/gPv9yH-X We’ve pulled together 2 days of deeply technical sessions from teams building and running Velox, Presto, Spark/Gluten, and next-gen AI and data infra in production. This year’s program leans into a few clear themes: 🔹 AI-native workloads on data infrastructure - iteration, vector search, RAG, and agentic pipelines 🔹 Hardware acceleration - GPU-native execution, CXL memory, hybrid CPU/GPU planning 🔹 Real-world adoption - Meta, Uber, Oracle, Microsoft, IBM, and others sharing production learnings 🔹 Expanding the Velox ecosystem - new databases, query layers, and execution models built on Velox We hope you can join us and can't wait to see the community! Registration is free while supplies last 😉 📅 April 29-30, 2026 📍 Meta HQ, Menlo Park https://veloxcon.io/ Meta Open Source IBM Data, AI & Automation Uber Engineering Microsoft Developer Presto Foundation Apache Gluten SereneDB
-
-
We are pleased to announce the release of Apache Gluten 1.6.0! Apache Gluten is a middle layer responsible for offloading JVM-based SQL engines’ execution to native engines, improving query performance and resource efficiency. You can download the release here: https://lnkd.in/epBjJsVD We would like to thank all contributors who helped make this release possible. For more information about Apache Gluten, please visit: https://gluten.apache.org/
-
🎉 Apache Gluten has officially graduated from the Apache Incubator and is now an Apache Top‑Level Project (TLP)! A major milestone recognizing the project’s maturity, strong community, and long‑term sustainability under the Apache Software Foundation. https://lnkd.in/gnJuD8t8 #opensource
-
Thank you to Soumil S. for having us and Rui Mo for giving a great session! Always great to meet the community and share more about the Gluten 🩵
🚀 Learn Apache Gluten & Apache Iceberg | Featuring Rui Mo (IBM) & Soumil Shah Zeta Global Video Links https://lnkd.in/eSttM8k5 PPT : https://lnkd.in/eNku3Xyb In this video, we dive deep into Apache Gluten and its integration with Apache Iceberg, exploring how it enhances query performance and brings native acceleration to big data workloads. I’m joined by Rui Mo, Software Engineer at IBM and contributor to Apache Gluten, where we discuss: 🔹 What Apache Gluten is and why it matters🔹 How Gluten improves Spark performance🔹 Integration with Apache Iceberg🔹 Real-world use cases and architecture insights🔹 Community, roadmap, and how to get involved If you’re working in Data Engineering, Spark, Iceberg, or Lakehouse architectures, this session will give you practical insights straight from the community. 🔗 Useful Links 👉 Apache Gluten GitHub:https://lnkd.in/eyHVxs7T 👉 LinkedIn Page:https://lnkd.in/eNH8T-A3 👉 ASF Slack Channel:#incubator-gluten 👉 WeChat Group:Gluten 使用者社区 💡 Don’t forget to like, share, and subscribe for more deep dives into Data Engineering, Apache Iceberg, Lakehouse architecture, and performance optimization! Rui Mo
-
-
Native execution is becoming a key direction for Apache Spark performance. This post dives into how Apache Gluten + Velox enable vectorized execution and improved efficiency for real‑world Spark workloads.
Apache Spark powers some of the largest data workloads in the world. But as data volumes grow, even well‑tuned Spark jobs can start to hit performance limits. What happens when the same Spark code runs on a fundamentally faster execution engine—without requiring rewrites or new abstractions? In this post, I take you under the hood of the Native Execution Engine (NEE) in Microsoft Fabric—a vectorized, C++‑powered execution layer that accelerates Spark workloads while preserving the developer experience. We walk through how columnar processing and SIMD unlock better CPU utilization, how Fabric integrates open‑source technologies like Apache Gluten and Velox to deliver performance gains with no code changes, and what this means for cost, predictability, and operational simplicity in real Spark pipelines. The result is faster Spark jobs, better hardware efficiency, and performance gains that come from the engine—not from endless tuning or cluster scaling. Read the full blog post to dive deep: https://lnkd.in/gGvv5ZjU #MicrosoftFabric #ApacheSpark #DataEngineering #NativeExecutionEngine #Velox #ApacheGluten #BigData Ashit Gosalia, Ajith S, Wei Ting Chen, Justyna Lucznik, Avinanda Chattapadday, Santhosh Kumar Ravindran
-
Thanks to Bytedance’s generous sponsorship, we successfully hosted GlutenCon on 12/6/2025. The entire Apache Gluten community is thrilled to see how the technology is helping customers reduce their costs. Below is a quick chart showing how much some of our users were able to cut their Spark cluster expenses by adopting Gluten. Welcome to share your story of Gluten Adoptions. We also want to express our deep appreciation to Gluten’s users. Their adoption, along with the countless bugs they discovered and helped resolve along the way, is what enabled Gluten to reach production‑grade maturity in just three short years. We sincerely hope that Gluten can help even more customers reduce their ever‑increasing Spark cluster costs.
-
-
🚀 Big Data at Lightning Speed! Missed Community Over Code 2025? Don’t worry—we’ve got you covered! Dive into the latest breakthroughs with Apache Gluten and see how industry leaders are accelerating Spark and Flink at scale: ✅ ByteDance: Accelerating Spark Jobs with Apache Gluten ▶ https://lnkd.in/gpPegbxQ ✅ SF Express: Journey with Apache Spark and Gluten ▶ https://lnkd.in/gHpFvY4N ✅ Xiaomi: Production Practice of Apache Gluten & Celeborn ▶ https://lnkd.in/gGgwcepx ✅ Gluten + Velox Engine on Arm64 ▶ https://lnkd.in/gjZwRtkF 💡 Gluten: Use Native Engine to Accelerate Spark & Flink ▶ https://lnkd.in/gS74Dx7P #CommunityOverCode #ApacheGluten #ApacheSpark #ASF #BigData #DataEngineering #OpenSource #ByteDance #SFExpress #Xiaomi #Velox #Flink
-
We're looking forward to hearing from many of our users at #VeloxCon China on Dec. 13 at Ant Group offices in Beijing 👏 hope to see many of our Gluten community there!
#VeloxCon China session spotlight: Optimization and Practice of Velox for Accelerating Lakehouse Analytics with Iceberg in WeChat This talk shares how Tencent Wechat deployed Velox (via Apache Gluten) in large-scale production, covering their canary release system, engineering improvements to vectorized writes and Spark SQL functions, and key stability work around memory management and disk overflow protection. They will also detail a metrics and reporting platform used to track adoption, performance gains, and overall efficiency improvements across SQL workloads. Featuring Jinhai Chen from Tencent Wechat. Date: Sat, Dec 13 at Ant Group Offices in Beijing Agenda: https://lnkd.in/gup_RFBv Register: https://lnkd.in/gqUhePzR Weixin/WeChat Tencent Cloud International Developer
-
-
With the generous support of ByteDance, we are excited to host the very first GlutenCon in Beijing on December 6, 2025 We warmly welcome you to join us for this milestone event! More details: https://lnkd.in/gyjrKryW Date: Saturday, December 6, 2025 Time: 09:00 AM – 06:00 PM Location: ByteDance Headquarters, Beijing (Building 1, Dazhongsi Plaza, No.18 Jia, North Third Ring West Road, Haidian District) Hosted by: Apache Gluten Community & ByteDance
-