Dinky is a real-time data development platform based on Apache Flink, enabling agile data development, deployment and operation.
-
Updated
May 21, 2025 - Java
#
datawarehouse
Here are 495 public repositories matching this topic...
Postgres-native columnar storage extension
-
Updated
Feb 10, 2025 - C
A free to use dbt package for creating and loading Data Vault 2.0 compliant Data Warehouses (powered by dbt, an open source data engineering tool, registered trademark of dbt Labs)
metadata sql etl snowflake datawarehousing dbt elt datawarehouse datalake dataengineering datavault datavault20 data-vault
-
Updated
Mar 12, 2025
An open-source columnar data format designed for fast & realtime analytic with big data.
-
Updated
Nov 16, 2022 - Java
Free and open source schema versioning and database migration made natively with .NET/6. NEW THIS MAY 2022! v1.3.15 released!
mysql sql postgresql oracle snowflake mariadb data-engineering database-migrations dotnet-core redshift sqlserver datawarehouse azure-sql-database amazon-rds dotnet-tool yuniql
-
Updated
Jul 25, 2024 - C#
Hydra九头龙，面向PB级别知识库取数、情报系统、数据平台、大规模控制调度系统。建设云计算资源管理、任务/服务统一调度、数仓、微服务化、中台基建系统化能力。——以实现大规模分布式爬虫搜索引擎为例。
infrastructure search-engine distributed-systems crawler cloud microservice architecture bigdata operating-system knowledge-graph quant datawarehouse
-
Updated
May 28, 2025 - Java
Timeseries Anomaly detection and Root Cause Analysis on data in SQL data warehouses and databases
bigquery sql snowflake redshift anomaly datawarehouse anomaly-detection timeseries-analysis timeseries-forecasting root-cause-analysis prophet-facebook
-
Updated
Feb 23, 2022 - Python
Roadmap for Data Engineering
devops data-science machine-learning development roadmap awesome cloud database deep-learning interview ci-cd awesome-list guidelines datawarehouse datapipeline dataengineering awesome-resources datapreprocessing mlops
-
Updated
Jun 20, 2024 - Java
Dataplane is an Airflow inspired unified data platform with additional data mesh and RPA capability to automate, schedule and design data pipelines and workflows. Dataplane is written in Golang with a React front end.
kubernetes golang finance workflow data-science data airflow etl scheduler pipelines data-engineering data-analysis data-integration workflows data-pipelines datawarehouse dataplane workflow-automation rpa robotics-process-automation
-
Updated
Mar 28, 2025 - JavaScript
A comprehensive guide to building a modern data warehouse with SQL Server, including ETL processes, data modeling, and analytics.
data-science sql sql-server etl data-warehouse sql-query datascience data-engineering data-analytics datawarehousing data-analysis sqlserver datawarehouse data-cleaning datalake data-warehousing etl-pipeline etl-job data-lakehouse medallion-architecture
-
Updated
Apr 23, 2025 - TSQL
Service for bulk-loading data to databases with automatic schema management (Redshift, Snowflake, BigQuery, ClickHouse, Postgres, MySQL)
-
Updated
May 28, 2025 - Go
All of my individual learning materials, documents, and notes from the process of getting the Coursera IBM Data Engineer Professional Certificate specialization are stored in this repository.
-
Updated
Dec 14, 2022 - Jupyter Notebook
A curated list of awesome Online Analytical Processing databases, frameworks, ressources and other awesomeness.
processing streaming awesome sql database big-data timeseries analytics stream-processing olap awesome-list batch-processing datawarehouse datalake metastore lakehouse
-
Updated
Jan 4, 2025
Accelerator to build a Microsoft Fabric modern data platform using pre-built reusable Fabric items and an orchestration ELT Framework
pipeline accelerator datawarehouse eventstream spark-notebook data-factory kusto lakehouse elt-framework microsoft-fabric iac-bicep real-time-intelligence
-
Updated
Apr 28, 2025 - Python
implementing an end-to-end tweets ETL/Analysis pipeline.
tweets analysis twitter-api multithreading api-client datawarehousing datawarehouse web-crawling ssis google-api-client etl-pipeline tweets-classification cube-analysis powerbi-report ssas-multidimensional multi-dimensional-analysis tweets-scraper
-
Updated
Dec 8, 2022 - Python
End to end data engineering project
postgresql python3 data-engineering data-platform data-analysis data-processing datawarehouse data-pipeline dagster
-
Updated
Oct 27, 2022 - Python
AlphaSQL provides Integrated Type and Schema Check and Parallelization for SQL file set mainly for BigQuery
docker graphviz bigquery typechecker dependency-analysis dependency-graph parallelization pipeline-framework elt datawarehouse workflow-automation cycle-detection dot-language datawarehouseautomation workflow-tool zetasql
-
Updated
Jun 20, 2022 - C++
Improve this page
Add a description, image, and links to the datawarehouse topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the datawarehouse topic, visit your repo's landing page and select "manage topics."