pekko-playground-reference

cdc

blog

Inspired by https://github.com/MichaelCade/90DaysOfDevOps

Rewrite prism, A highly concurrent system using ZIO

The Lineage Analysis system for FlinkSQL supports advanced syntax such as Watermark, UDTF, CEP, Windowing TVFs, and CTAS.

study calcite

An embedded key/value database for Go.

AKShare is an elegant and simple financial data interface library for Python, built for human beings! 开源财经数据接口库

基于大模型(DeepSeek,OpenAI等)的 GitLab 自动代码审查工具；支持钉钉/企业微信/飞书推送消息和生成日报；支持Docker部署；可视化 Dashboard。

Apache ZooKeeper

A functional wrapper around Spark to make it works with ZIO

zio-reference

A minimal quickstart ZIO application for writing a RESTful Web Service

An idiomatic ZIO client for the Kubernetes API.

Direct-Style Programming for ZIO

Scala ZIO-powered Apache Parquet library

Code at the speed of thought – Zed is a high-performance, multiplayer code editor from the creators of Atom and Tree-sitter.

A youtube-dl fork with additional features and fixes

test project

paper noter

javafx game

A distributed task scheduling framework.（分布式任务调度平台XXL-JOB）

Config files for my GitHub profile.

用Rust实现仿nginx，力争实现一个可替代方案，http/https代理, socks5代理, 负载均衡, 反向代理, 静态文件服务器，四层TCP/UDP转发，websocket转发, 内网穿透nat

A scalable web crawler framework for Java.

首家工业级全流程 AI 影视生产平台。Industry-first professional AI Agent platform for controllable film & video production. From shorts to live-action with Hollywood-standard workflows.

A Cloud Native Batch System (Project under CNCF)

Open-Source Frontier Voice AI

Uniffle is a high performance, general purpose Remote Shuffle Service.

Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)

Trae Agent is an LLM-based agent for general purpose software engineering tasks.

(🚧 WIP) a course of serving LLM on Apple Silicon for systems engineers.

Distributed transactional key-value database, originally created to complement TiDB

This repo maintains DM (a data migration platform) and TiCDC (change data capture for TiDB)

An example for testcontainers-java and TiDB.

TiDB is an open source distributed HTAP database compatible with the MySQL protocol

Data platform

TiDB connectors for Flink/Hive/Presto

Graphic notes on Gilbert Strang's "Linear Algebra for Everyone"

A sample MySQL database with an integrated test suite, used to test your applications and database servers

Testcontainers is a Java library that supports JUnit tests, providing lightweight, throwaway instances of common databases, Selenium web browsers, or anything else that can run in a Docker container.

A sample template with guidelines for writing technical articles.

The easiest, most secure way to use WireGuard and 2FA.

Learn how to design large-scale systems. Prep for the system design interview. Includes Anki flashcards.

Apache Superset is a Data Visualization and Data Exploration Platform

Make Flink|Spark easier!!! The original intention of StreamX is to make the development of Flink easier. StreamX focuses on the management of development phases and tasks. Our ultimate goal is to build a one-stop big data solution integrating stream processing, batch processing, data warehouse and data laker.

Design of refactored streampark flink-kubernetes module

Zero-ETL, infinite possibilities. Live query APIs, code & more with SQL. No DB required.

Kubernetes Operator for StarRocks

StarRocks, a Linux Foundation project, is a next-generation sub-second MPP OLAP database for full analytics scenarios, including multi-dimensional analytics, real-time analytics, and ad-hoc queries. InfoWorld’s 2023 BOSSIE Award for best open source software.

🍃spring-rs is a application framework written in rust inspired by java's spring-boot

Agentic AI Framework for Java Developers

Speakr is a personal, self-hosted web application designed for transcribing audio recordings

spark-reference

Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.

Apache Spark Kubernetes Operator

Apache Spark - A unified analytics engine for large-scale data processing

「妙幕」是一款跨平台客户端工具，可以批量为视频或者音频生成字幕文件，并支持对字幕进行翻译，支持百度、火山、openai、ollama、deepseek 等多家翻译

Slick (Scala Language Integrated Connection Kit) is a modern database query and access library for Scala

Modern database IDE for your dev & data workflows. Supports MySQL, PostgreSQL & MongoDB.

For an introductory tutorial on how to use Jenkins to build a simple Java application with Maven.

Apache ShenYu is a Java native API Gateway for service proxy, protocol conversion and API governance.

A powerful flow control component enabling reliability, resilience and monitoring for microservices. (面向云原生微服务的高可用流控防护组件)

A unified framework for privacy-preserving data analysis and machine learning

SeaTunnel is a distributed, high-performance data integration platform for the synchronization and transformation of massive data (offline & real-time).

SeaTunnel is a distributed, high-performance data integration platform for the synchronization and transformation of massive data (offline & real-time).

Repository for out-of-tree scheduler plugins based on scheduler framework.

instructions for Scala use

scala simple demo

sbt Native Packager

🚀 High-performance distributed object storage for MinIO alternative.

📰 🥫 Use RSS CAN be better and simple.

🚀 A high performance NoSQL database based on bitcask, supports string, list, hash, set, and sorted set.

Nacos server re-implemented in Rust.

RisingWave: A Distributed SQL Database for Stream Processing

An educational OLAP database system.

Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.

Quick illustration of how one can easily read books together with LLMs. It's great and I highly recommend it.

Reactive Streams Specification for the JVM

RAGFlow is an open-source RAG (Retrieval-Augmented Generation) engine based on deep document understanding.

为键盘工作者设计的单词记忆与英语肌肉记忆锻炼软件 / Words learning and English muscle memory training software designed for keyboard workers

Quickly view your data

🚀 PR-Agent: An AI-Powered 🤖 Tool for Automated Pull Request Analysis, Feedback, Suggestions and More! 💻🔍

Enterprise job scheduling middleware with distributed computing ability.

A scalable Netflix DBLog implementation for PostgreSQL

Pentaho Data Integration ( ETL ) a.k.a Kettle

Apache Pekko Sample Projects

Quartz Extension and utilities for cron-style scheduling in Apache Pekko

Apache Pekko Connectors is a Reactive Enterprise Integration library for Java and Scala, based on Reactive Streams and Apache Pekko.

Turn any PDF or image document into structured data for your AI. A powerful, lightweight OCR toolkit that bridges the gap between images/PDFs and LLMs. Supports 100+ languages.

OpenMetadata is a unified metadata platform for data discovery, data observability, and data governance powered by a central metadata repository, in-depth column level lineage, and seamless team collaboration.

Open Multi-Agent Interactive Classroom — Get an immersive, multi-agent learning experience in just one click

An Open Standard for lineage metadata collection

AI-Native Risk Intelligence Systems, OpenDeRisk——Your application system risk intelligent manager provides 7* 24-hour comprehensive and in-depth protection.

Your own personal AI assistant. Any OS. Any Platform. The lobster way. 🦞

Get up and running with Llama 3.2, Mistral, Gemma 2, and other large language models.

A simple, fast, embeddable, persistent key/value store written in pure Go. It supports fully serializable transactions and many data structures such as list, set, sorted set.

西北五狗的刷leetcode之路

Weekly Go Online Meetup via Bilibili｜Go 夜读｜通过 bilibili 在线直播的方式分享 Go 相关的技术话题，每天大家在微信/telegram/Slack 上及时沟通交流编程技术话题。

Netty project - an event-driven asynchronous network application framework

🎧☁️ Modern Music Server and Streamer compatible with Subsonic/Airsonic

A lightweight alternative to OpenClaw that runs in containers for security. Connects to WhatsApp, Telegram, Slack, Discord, Gmail and other messaging apps,, has memory, scheduled jobs, and runs directly on Anthropic's Agents SDK

an easy-to-use dynamic service discovery, configuration and service management platform for building cloud native applications.

MySQL Binary Log connector

MiniOB is one mini database, helping developers to learn how database works.

Guidance on documentation, scripts and integration steps on using the EDC project results

A tutorial of building an LSM-Tree storage engine in a week! (WIP)

Your shiny new Java/Scala build tool!

The simplest, fastest way to get business intelligence and analytics to everyone in your company

Create book from markdown files. Like Gitbook but implemented in Rust

Maxwell's daemon, a mysql-to-json kafka producer

DeepSeek Harness: Everything is a Plugin.

An open-source cross-platform alternative to AirDrop

一个漂亮, 简单的基于web的linux服务器监控面板

the source code of linux-0.11 for study linux kernel

Apache Linkis builds a computation middleware layer to facilitate connection, governance and orchestration between the upper applications and the underlying data engines.

LevelDB is a fast key-value storage library written at Google that provides an ordered mapping from string keys to string values.

Demonstrate all the questions on LeetCode in the form of animation.（用动画的形式呈现解LeetCode题目的思路）

Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.

The container platform tailored for Kubernetes multi-cloud, datacenter, and edge management ⎈ 🖥 ☁️

Java client for Kubernetes & OpenShift

Kronos: A Foundation Model for the Language of Financial Markets

build the SQL layer of KipDB database

Distributed Tracing, Metrics and Context Propagation for applications running on the JVM

Mirror of Apache Kafka

Libraries to help developers express architectural abstractions in Java code

【低代码迈入v2.0时代，一句话即可生成整个系统】企业级AI低代码平台，一键生成前后端代码甚至整个系统。 AI Skills 一句话画流程、设计表单、生成报表、大屏。内置 AI应用平台涵盖：AI聊天、知识库、流程编排、MCP插件等，兼容主流大模型。引领AI低代码「Skills 生成 → 在线配置 → 代码生成 → 手工合并->AI修改」开发模式，解决 Java 项目 90% 重复工作，提高效率又不失灵活。

Java SDK for building Kubernetes Operators

Apache InLong - a one-stop integration framework for massive data

Build highly concurrent, distributed, and resilient message-driven applications using Java/Scala

Apache Paimon(incubating) is a streaming data lake platform that supports high-speed data ingestion, change data tracking and efficient real-time analytics.

Apache OpenDAL: access data freely.

Apache Celeborn is an elastic and high-performance service for shuffle and spilled data.

Fast and Lightweight Observability Data Collector

This is the companion repository for the book How Query Engines Work.

🚧 持续更新 🚧 记录搭建兼顾学习娱乐的家用网络环境的过程，折腾过的一些软硬件小经验。

光 HikariCP・A solid, high-performance, JDBC connection pool at last.

I plan to create a custom client with reference to HeidiSQL.

Xiaomi Home Integration for Home Assistant

Hazelcast is a unified real-time data platform combining stream processing with a fast data store, allowing customers to act instantly on data-in-motion for real-time insights.

Apache Hadoop

Google core libraries for Java

World's most powerful open data catalog for building a high-performance, geo-distributed and federated metadata lake.

为ChatGPT/GLM提供图形交互界面，特别优化论文阅读/润色/写作体验，模块化设计，支持自定义快捷按钮&函数插件，支持Python和C++等项目剖析&自译解功能，PDF/LaTex论文翻译&总结功能，支持并行问询多种LLM模型，支持清华chatglm2等本地模型。兼容复旦MOSS, llama, rwkv, newbing, claude, claude2等

1 min voice data can also be used to train a good TTS model! (few shot voice cloning)

Play Golang in Web by Docker!

an unified scheduler for online and offline tasks

Gluten: Plugin to Double SparkSQL's Performance

Cross platform GUI toolkit in Go inspired by Material Design

Java / JavaFX / Kotlin Game Library (Engine)

分享我的编程经验和学习心得，订阅请点 watch。

Personal learning flink demo

flink learning blog. http://www.54tianzhisheng.cn 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例，还有 Flink 落地应用的大型项目案例（PVUV、日志存储、百亿数据实时去重、监控告警）分享。欢迎大家支持我的专栏《大数据实时计算引擎 Flink 实战与性能优化》

Apache Flink Kubernetes Operator

CDC Connectors for Apache Flink®

Apache Flink

The Feldera Incremental Computation Engine

A simple, fast and user-friendly alternative to 'find'

A production-ready FastAPI template for building AI agent applications with LangGraph integration. This template provides a robust foundation for building scalable, secure, and maintainable AI agent services.

Distributed reliable key-value store for the most critical data of a distributed system

Generates an audiobook with chapters and ebook metadata using Calibre and Xtts from Coqui tts, and with optional voice cloning, and supports multiple languages

A distributed transaction framework, supports workflow, saga, tcc, xa, 2-phase message, outbox patterns, supports many languages.

Stream Loader for Apache Doris

Spark Connector for Apache Doris

An operator for Apache Doris that manages Doris cluster and observability components through Kubernetes CRs 😆

Doris kubernetes operator

Flink Connector for Apache Doris

Apache Doris is an easy-to-use, high performance and unified analytics database.

Apache DolphinScheduler is a distributed and extensible workflow scheduler platform with powerful DAG visual interfaces, dedicated to solving complex job dependencies in the data pipeline and providing various types of jobs available out of box.

Flare ✨ Lightweight, high performance and fast self-hosted navigation pages, resource utilization rate is <1% CPU, MEM <30 M, Docker Image < 10M

Data Migration Platform

Dinky is a real-time data development platform based on Apache Flink, enabling agile data development, deployment and operation.

A hands-on introduction to video technology: image, video, codec (av1, vp9, h265) and more (ffmpeg encoding). Translations: 🇺🇸 🇨🇳 🇯🇵 🇮🇹 🇰🇷 🇷🇺 🇧🇷 🇪🇸

Dify is an open-source LLM app development platform. Dify's intuitive interface combines AI workflow, RAG pipeline, agent capabilities, model management, observability features and more, letting you quickly go from prototype to production.

Instant, easy, and predictable development environments

Open Source DeepWiki: AI-Powered Wiki Generator for GitHub/Gitlab/Bitbucket Repositories. Join the discord: https://discord.gg/gMwThUMeme

My own open source implementation of OpenAI's new Deep Research agent. Get the same capability without paying $200. You can even tweak the behavior of the agent with adjustable breadth and depth. Run it for 5 min or 5 hours, it'll auto adjust.

Change data capture for a variety of databases. Please log issues at https://issues.redhat.com/browse/DBZ.

Literature references for “Designing Data-Intensive Applications”

Free universal database tool and SQL client

Readings in Databases

AI Native Data App Development framework with AWEL(Agentic Workflow Expression Language) and Agents

DataX是阿里云DataWorks数据集成的开源版本。

A DataFusion table provider for executing SQL queries on remote databases.

Apache DataFusion Comet Spark Accelerator

人人可用的开源数据可视化分析工具。

LLM 驱动的多市场股票智能分析系统：多源行情、实时新闻、决策看板与自动推送，支持零成本定时运行。 LLM-powered multi-market stock analysis system with multi-source market data, real-time news, decision dashboard, automated notifications, and cost-free scheduled runs.

An editor built for programming with AI 🤖

cube studio开源云原生一站式机器学习/深度学习/大模型AI平台，支持sso登录，多租户，大数据平台对接，notebook在线开发，拖拉拽任务流pipeline编排，多机多卡分布式训练，超参搜索，推理服务VGPU，边缘计算，serverless，标注平台，自动化标注，数据集管理，大模型微调，vllm大模型推理，llmops，私有知识库，AI模型应用商店，支持模型一键开发/推理/微调，支持国产cpu/gpu/npu芯片，支持RDMA，支持pytorch/tf/mxnet/deepspeed/paddle/colossalai/horovod/spark/ray/volcano分布式

📊 Cube — The Semantic Layer for Building Data Applications

计算机自学指南

Cross-platform CRON expression parsing for Scala

Coral is a translation, analysis, and query rewrite engine for SQL and other relational languages.

⏩ Continue is the leading open-source AI code assistant. You can connect any models and any context to build custom autocomplete and chat experiences inside VS Code and JetBrains

Container runtimes on macOS (and Linux) with minimal setup

Lightweight coding agent that runs in your terminal

CMAK is a tool for managing Apache Kafka clusters

Cloud Shuffle Service(CSS) is a general purpose remote shuffle solution for compute engines, including Spark/Flink/MapReduce.

TiKV Java Client

A data integration framework

The most comprehensive database of Chinese poetry 🧶最全中华古诗词数据库, 唐宋两朝近一万四千古诗人, 接近5.5万首唐诗加26万宋诗. 两宋时期1564位词人，21050首词。

用 Express 和 Vue3 搭建的 ChatGPT 演示网页

Tiny self-signed tool, file size between 1.5MB(binary) and 4MB (docker). Generate a self-hosted / dev certificate through configuration.

A cross-platform desktop All-in-One assistant for Claude Code, Codex, OpenCode, OpenClaw, Gemini CLI & Hermes Agent. Only official website: ccswitch.io

阿里巴巴 MySQL binlog 增量订阅&消费组件

Apache Calcite

Blazing-fast query execution engine speaks Apache Spark language and has Arrow-DataFusion at its core.

大数据入门指南

A MVP implementation of distributed query engine cut from datafusion-ballista codebase for learning purpose.

🧰 记录每一个与运维相关的优秀项目，⚗️ 项目内表格通过 GitHub Action 自动生成，📥 当前收录项目 651 个。

A community collection of OpenClaw use cases for making life easier.

AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.

Apache Arrow DataFusion SQL Query Engine

Apache Arrow Ballista Distributed Query Engine

Apache Arrow is a multi-language toolbox for accelerated data interchange and in-memory processing

High-performance Rust stream processing engine, providing powerful data stream processing capabilities, supporting multiple input/output sources and processors.

Framework to build data pipelines declaratively

Ape Data Transfer Suite, written in Rust. Provides ultra-fast data replication between MySQL, PostgreSQL, Redis, MongoDB, Kafka and ClickHouse, ideal for disaster recovery (DR) and migration scenarios.

Akka Sample Projects

Examples for Typed-Akka

Examples for Typed-Akka

The Streaming-first HTTP server/module of Akka

🌴 A chinese guide of Akka, based on Java.

Build highly concurrent, distributed, and resilient message-driven applications on the JVM

专为程序员编写的英语学习指南 v1.2。在线版本请点 ->