Skip to main content
Public
WebDev WebDev
Browse Files
2efcc4a9943c020fb6e67cef8939e6dca07ee3a2
Full Commit Hash
30565b1 Next
Commit Details
456 Added

Initial commit - Upload project 'data-engineering-zoomcamp'

WebDev
WebDev
Authored
January 19, 2026, 7:16 am
Statistics
456
Files Added
0
Files Modified
0
Files Deleted
0
Files Renamed
Changed Files 456 files
org
A Added · 06-streaming/java/kafka_examples/src/test/java
05-batch
A Added · cohorts/2026
example
A Added · 06-streaming/java/kafka_examples/src/test/java/org
homework.md 1.88 KB
A Added · cohorts/2026/05-batch
helper
A Added · 06-streaming/java/kafka_examples/src/test/java/org/example
06-streaming
A Added · cohorts/2026
DataGeneratorHelper.java 857 B
A Added · 06-streaming/java/kafka_examples/src/test/java/org/example/helper
homework.md 4.43 KB
A Added · cohorts/2026/06-streaming
JsonKStreamJoinsTest.java 2.8 KB
A Added · 06-streaming/java/kafka_examples/src/test/java/org/example
project.md 1.48 KB
A Added · cohorts/2026
JsonKStreamTest.java 3.03 KB
A Added · 06-streaming/java/kafka_examples/src/test/java/org/example
README.md 1.15 KB
A Added · cohorts/2026
ksqldb
A Added · 06-streaming
dataset.md 2.15 KB
A Added · .
commands.md 1021 B
A Added · 06-streaming/ksqldb
images
A Added · .
pyflink
A Added · 06-streaming
architecture
A Added · images
.gitignore 1.83 KB
A Added · 06-streaming/pyflink
arch_v3_workshops.jpg 309.18 KB
A Added · images/architecture
docker-compose.yml 2.83 KB
A Added · 06-streaming/pyflink
arch_v4_workshops.jpg 119.23 KB
A Added · images/architecture
Dockerfile.flink 1.79 KB
A Added · 06-streaming/pyflink
photo1700757552.jpeg 66.04 KB
A Added · images/architecture
homework.md 2.6 KB
A Added · 06-streaming/pyflink
aws
A Added · images
LICENSE 1.07 KB
A Added · 06-streaming/pyflink
iam.png 235.16 KB
A Added · images/aws
Makefile 1.45 KB
A Added · 06-streaming/pyflink
bruin.svg 5.86 KB
A Added · images
README.md 4.64 KB
A Added · 06-streaming/pyflink
dlthub.png 2.01 KB
A Added · images
requirements.txt 65 B
A Added · 06-streaming/pyflink
kestra.svg 7.6 KB
A Added · images
src
A Added · 06-streaming/pyflink
mage.svg 1.99 KB
A Added · images
job
A Added · 06-streaming/pyflink/src
piperider.png 10.56 KB
A Added · images
aggregation_job.py 3.07 KB
A Added · 06-streaming/pyflink/src/job
rising-wave.png 29.86 KB
A Added · images
start_job.py 2.47 KB
A Added · 06-streaming/pyflink/src/job
learning-in-public.md 1.38 KB
A Added · .
taxi_job.py 3.61 KB
A Added · 06-streaming/pyflink/src/job
projects
A Added · .
producers
A Added · 06-streaming/pyflink/src
datasets.md 1.81 KB
A Added · projects
load_taxi_data.py 777 B
A Added · 06-streaming/pyflink/src/producers
README.md 7.17 KB
A Added · projects
producer.py 564 B
A Added · 06-streaming/pyflink/src/producers
README.md 8.78 KB
A Added · .
python
A Added · 06-streaming
avro_example
A Added · 06-streaming/python
consumer.py 3.04 KB
A Added · 06-streaming/python/avro_example
producer.py 3.94 KB
A Added · 06-streaming/python/avro_example
ride_record_key.py 525 B
A Added · 06-streaming/python/avro_example
ride_record.py 837 B
A Added · 06-streaming/python/avro_example
settings.py 289 B
A Added · 06-streaming/python/avro_example
docker
A Added · 06-streaming/python
docker-compose.yml 3.38 KB
A Added · 06-streaming/python/docker
kafka
A Added · 06-streaming/python/docker
docker-compose.yml 2.63 KB
A Added · 06-streaming/python/docker/kafka
README.md 1.17 KB
A Added · 06-streaming/python/docker
spark
A Added · 06-streaming/python/docker
build.sh 658 B
A Added · 06-streaming/python/docker/spark
cluster-base.Dockerfile 600 B
A Added · 06-streaming/python/docker/spark
docker-compose.yml 1.08 KB
A Added · 06-streaming/python/docker/spark
jupyterlab.Dockerfile 389 B
A Added · 06-streaming/python/docker/spark
spark-base.Dockerfile 692 B
A Added · 06-streaming/python/docker/spark
spark-master.Dockerfile 194 B
A Added · 06-streaming/python/docker/spark
spark-worker.Dockerfile 224 B
A Added · 06-streaming/python/docker/spark
json_example
A Added · 06-streaming/python
consumer.py 1.48 KB
A Added · 06-streaming/python/json_example
producer.py 1.5 KB
A Added · 06-streaming/python/json_example
ride.py 1.73 KB
A Added · 06-streaming/python/json_example
settings.py 110 B
A Added · 06-streaming/python/json_example
README.md 1020 B
A Added · 06-streaming/python
redpanda_example
A Added · 06-streaming/python
consumer.py 1.9 KB
A Added · 06-streaming/python/redpanda_example
docker-compose.yaml 2.39 KB
A Added · 06-streaming/python/redpanda_example
producer.py 1.56 KB
A Added · 06-streaming/python/redpanda_example
README.md 4 KB
A Added · 06-streaming/python/redpanda_example
ride.py 1.73 KB
A Added · 06-streaming/python/redpanda_example
settings.py 110 B
A Added · 06-streaming/python/redpanda_example
requirements.txt 65 B
A Added · 06-streaming/python
resources
A Added · 06-streaming/python
rides.csv 23.95 KB
A Added · 06-streaming/python/resources
schemas
A Added · 06-streaming/python/resources
taxi_ride_key.avsc 168 B
A Added · 06-streaming/python/resources/schemas
taxi_ride_value.avsc 425 B
A Added · 06-streaming/python/resources/schemas
streams-example
A Added · 06-streaming/python
faust
A Added · 06-streaming/python/streams-example
branch_price.py 710 B
A Added · 06-streaming/python/streams-example/faust
producer_taxi_json.py 739 B
A Added · 06-streaming/python/streams-example/faust
stream_count_vendor_trips.py 446 B
A Added · 06-streaming/python/streams-example/faust
stream.py 353 B
A Added · 06-streaming/python/streams-example/faust
taxi_rides.py 176 B
A Added · 06-streaming/python/streams-example/faust
windowing.py 557 B
A Added · 06-streaming/python/streams-example/faust
pyspark
A Added · 06-streaming/python/streams-example
consumer.py 1.7 KB
A Added · 06-streaming/python/streams-example/pyspark
producer.py 2.13 KB
A Added · 06-streaming/python/streams-example/pyspark
README.md 1.18 KB
A Added · 06-streaming/python/streams-example/pyspark
settings.py 664 B
A Added · 06-streaming/python/streams-example/pyspark
spark-submit.sh 581 B
A Added · 06-streaming/python/streams-example/pyspark
streaming-notebook.ipynb 25.43 KB
A Added · 06-streaming/python/streams-example/pyspark
streaming.py 4.14 KB
A Added · 06-streaming/python/streams-example/pyspark
redpanda
A Added · 06-streaming/python/streams-example
.github
A Added · .
consumer.py 1.7 KB
A Added · 06-streaming/python/streams-example/redpanda
FUNDING.yml 23 B
A Added · .github
docker-compose.yaml 2.64 KB
A Added · 06-streaming/python/streams-example/redpanda
.gitignore 266 B
A Added · .
producer.py 2.13 KB
A Added · 06-streaming/python/streams-example/redpanda
01-docker-terraform
A Added · .
README.md 1.36 KB
A Added · 06-streaming/python/streams-example/redpanda
docker-sql
A Added · 01-docker-terraform
settings.py 664 B
A Added · 06-streaming/python/streams-example/redpanda
01-introduction.md 3.77 KB
A Added · 01-docker-terraform/docker-sql
spark-submit.sh 582 B
A Added · 06-streaming/python/streams-example/redpanda
02-virtual-environment.md 2.96 KB
A Added · 01-docker-terraform/docker-sql
streaming-notebook.ipynb 84.27 KB
A Added · 06-streaming/python/streams-example/redpanda
03-dockerizing-pipeline.md 2.33 KB
A Added · 01-docker-terraform/docker-sql
streaming.py 4.13 KB
A Added · 06-streaming/python/streams-example/redpanda
04-postgres-docker.md 2.9 KB
A Added · 01-docker-terraform/docker-sql
README.md 4.17 KB
A Added · 06-streaming
05-data-ingestion.md 5.57 KB
A Added · 01-docker-terraform/docker-sql
after-sign-up.md 708 B
A Added · .
06-ingestion-script.md 2.15 KB
A Added · 01-docker-terraform/docker-sql
asking-questions.md 3.15 KB
A Added · .
07-pgadmin.md 3.21 KB
A Added · 01-docker-terraform/docker-sql
awesome-data-engineering.md 8.86 KB
A Added · .
08-dockerizing-ingestion.md 2.01 KB
A Added · 01-docker-terraform/docker-sql
certificates.md 1.12 KB
A Added · .
09-docker-compose.md 2.98 KB
A Added · 01-docker-terraform/docker-sql
cohorts
A Added · .
10-sql-refresher.md 4.84 KB
A Added · 01-docker-terraform/docker-sql
2022
A Added · cohorts
11-cleanup.md 1.49 KB
A Added · 01-docker-terraform/docker-sql
project.md 1.19 KB
A Added · cohorts/2022
pipeline
A Added · 01-docker-terraform/docker-sql
README.md 264 B
A Added · cohorts/2022
.python-version 5 B
A Added · 01-docker-terraform/docker-sql/pipeline
week_1_basics_n_setup
A Added · cohorts/2022
docker-compose.yaml 521 B
A Added · 01-docker-terraform/docker-sql/pipeline
homework.md 2.38 KB
A Added · cohorts/2022/week_1_basics_n_setup
Dockerfile 255 B
A Added · 01-docker-terraform/docker-sql/pipeline
week_2_data_ingestion
A Added · cohorts/2022
ingest_data.py 2.31 KB
A Added · 01-docker-terraform/docker-sql/pipeline
airflow
A Added · cohorts/2022/week_2_data_ingestion
pyproject.toml 369 B
A Added · 01-docker-terraform/docker-sql/pipeline
.env_example 969 B
A Added · cohorts/2022/week_2_data_ingestion/airflow
README.md 4.6 KB
A Added · 01-docker-terraform/docker-sql
1_setup_official.md 4.18 KB
A Added · cohorts/2022/week_2_data_ingestion/airflow
README.md 6.41 KB
A Added · 01-docker-terraform
2_setup_nofrills.md 4.81 KB
A Added · cohorts/2022/week_2_data_ingestion/airflow
terraform
A Added · 01-docker-terraform
dags
A Added · cohorts/2022/week_2_data_ingestion/airflow
1_terraform_overview.md 2.58 KB
A Added · 01-docker-terraform/terraform
dags_local
A Added · cohorts/2022/week_2_data_ingestion/airflow
2_gcp_overview.md 2.03 KB
A Added · 01-docker-terraform/terraform
data_ingestion_local.py 1.41 KB
A Added · cohorts/2022/week_2_data_ingestion/airflow/dags_local
README.md 634 B
A Added · 01-docker-terraform/terraform
ingest_script.py 1.35 KB
A Added · cohorts/2022/week_2_data_ingestion/airflow/dags_local
terraform
A Added · 01-docker-terraform/terraform
data_ingestion_gcs_dag.py 3.62 KB
A Added · cohorts/2022/week_2_data_ingestion/airflow/dags
README.md 514 B
A Added · 01-docker-terraform/terraform/terraform
docker-compose_2.3.4.yaml 8.07 KB
A Added · cohorts/2022/week_2_data_ingestion/airflow
terraform_basic
A Added · 01-docker-terraform/terraform/terraform
docker-compose-nofrills.yml 1.45 KB
A Added · cohorts/2022/week_2_data_ingestion/airflow
main.tf 884 B
A Added · 01-docker-terraform/terraform/terraform/terraform_basic
docker-compose.yaml 9.95 KB
A Added · cohorts/2022/week_2_data_ingestion/airflow
terraform_with_variables
A Added · 01-docker-terraform/terraform/terraform
Dockerfile 1.14 KB
A Added · cohorts/2022/week_2_data_ingestion/airflow
main.tf 627 B
A Added · 01-docker-terraform/terraform/terraform/terraform_with_variables
docs
A Added · cohorts/2022/week_2_data_ingestion/airflow
variables.tf 1.04 KB
A Added · 01-docker-terraform/terraform/terraform/terraform_with_variables
1_concepts.md 2.58 KB
A Added · cohorts/2022/week_2_data_ingestion/airflow/docs
windows.md 3.33 KB
A Added · 01-docker-terraform/terraform
arch-diag-airflow.png 15.97 KB
A Added · cohorts/2022/week_2_data_ingestion/airflow/docs
02-workflow-orchestration
A Added · .
gcs_ingestion_dag.png 91.46 KB
A Added · cohorts/2022/week_2_data_ingestion/airflow/docs
docker-compose.yml 2.26 KB
A Added · 02-workflow-orchestration
extras
A Added · cohorts/2022/week_2_data_ingestion/airflow
flows
A Added · 02-workflow-orchestration
data_ingestion_gcs_dag_ex2.py 3.03 KB
A Added · cohorts/2022/week_2_data_ingestion/airflow/extras
01_hello_world.yaml 995 B
A Added · 02-workflow-orchestration/flows
web_to_gcs.sh 312 B
A Added · cohorts/2022/week_2_data_ingestion/airflow/extras
02_python.yaml 1.07 KB
A Added · 02-workflow-orchestration/flows
README.md 3.5 KB
A Added · cohorts/2022/week_2_data_ingestion/airflow
03_getting_started_data_pipeline.yaml 1.38 KB
A Added · 02-workflow-orchestration/flows
requirements.txt 40 B
A Added · cohorts/2022/week_2_data_ingestion/airflow
04_postgres_taxi.yaml 11.49 KB
A Added · 02-workflow-orchestration/flows
scripts
A Added · cohorts/2022/week_2_data_ingestion/airflow
05_postgres_taxi_scheduled.yaml 11.59 KB
A Added · 02-workflow-orchestration/flows
entrypoint.sh 364 B
A Added · cohorts/2022/week_2_data_ingestion/airflow/scripts
06_gcp_kv.yaml 631 B
A Added · 02-workflow-orchestration/flows
homework
A Added · cohorts/2022/week_2_data_ingestion
07_gcp_setup.yaml 603 B
A Added · 02-workflow-orchestration/flows
homework.md 3.32 KB
A Added · cohorts/2022/week_2_data_ingestion/homework
08_gcp_taxi.yaml 18.7 KB
A Added · 02-workflow-orchestration/flows
solution.py 6.13 KB
A Added · cohorts/2022/week_2_data_ingestion/homework
09_gcp_taxi_scheduled.yaml 18.7 KB
A Added · 02-workflow-orchestration/flows
README.md 2.9 KB
A Added · cohorts/2022/week_2_data_ingestion
10_chat_without_rag.yaml 1.26 KB
A Added · 02-workflow-orchestration/flows
transfer_service
A Added · cohorts/2022/week_2_data_ingestion
11_chat_with_rag.yaml 1.98 KB
A Added · 02-workflow-orchestration/flows
README.md 377 B
A Added · cohorts/2022/week_2_data_ingestion/transfer_service
images
A Added · 02-workflow-orchestration
week_3_data_warehouse
A Added · cohorts/2022
homework.png 715.85 KB
A Added · 02-workflow-orchestration/images
airflow
A Added · cohorts/2022/week_3_data_warehouse
README.md 33.05 KB
A Added · 02-workflow-orchestration
.env_example 969 B
A Added · cohorts/2022/week_3_data_warehouse/airflow
03-data-warehouse
A Added · .
1_setup_official.md 4.18 KB
A Added · cohorts/2022/week_3_data_warehouse/airflow
big_query_hw.sql 1.02 KB
A Added · 03-data-warehouse
2_setup_nofrills.md 4.81 KB
A Added · cohorts/2022/week_3_data_warehouse/airflow
big_query_ml.sql 2.08 KB
A Added · 03-data-warehouse
dags
A Added · cohorts/2022/week_3_data_warehouse/airflow
big_query.sql 2.12 KB
A Added · 03-data-warehouse
gcs_to_bq_dag.py 2.79 KB
A Added · cohorts/2022/week_3_data_warehouse/airflow/dags
extract_model.md 843 B
A Added · 03-data-warehouse
docker-compose-nofrills.yml 1.45 KB
A Added · cohorts/2022/week_3_data_warehouse/airflow
extras
A Added · 03-data-warehouse
docker-compose.yaml 10.01 KB
A Added · cohorts/2022/week_3_data_warehouse/airflow
README.md 283 B
A Added · 03-data-warehouse/extras
docs
A Added · cohorts/2022/week_3_data_warehouse/airflow
web_to_gcs.py 2.07 KB
A Added · 03-data-warehouse/extras
gcs_2_bq_dag_graph_view.png 120.79 KB
A Added · cohorts/2022/week_3_data_warehouse/airflow/docs
README.md 4.9 KB
A Added · 03-data-warehouse
gcs_2_bq_dag_tree_view.png 37.73 KB
A Added · cohorts/2022/week_3_data_warehouse/airflow/docs
04-analytics-engineering
A Added · .
README.md 3.34 KB
A Added · cohorts/2022/week_3_data_warehouse/airflow
README.md 5.81 KB
A Added · 04-analytics-engineering
scripts
A Added · cohorts/2022/week_3_data_warehouse/airflow
refreshers
A Added · 04-analytics-engineering
entrypoint.sh 364 B
A Added · cohorts/2022/week_3_data_warehouse/airflow/scripts
SQL.md 11.47 KB
A Added · 04-analytics-engineering/refreshers
week_5_batch_processing
A Added · cohorts/2022
setup
A Added · 04-analytics-engineering
homework.md 1.91 KB
A Added · cohorts/2022/week_5_batch_processing
cloud_setup.md 8.47 KB
A Added · 04-analytics-engineering/setup
week_6_stream_processing
A Added · cohorts/2022
local_setup.md 7.9 KB
A Added · 04-analytics-engineering/setup
homework.md 244 B
A Added · cohorts/2022/week_6_stream_processing
taxi_rides_ny
A Added · 04-analytics-engineering
2023
A Added · cohorts
.gitignore 1.08 KB
A Added · 04-analytics-engineering/taxi_rides_ny
leaderboard.md 39.2 KB
A Added · cohorts/2023
dbt_project.yml 484 B
A Added · 04-analytics-engineering/taxi_rides_ny
project.md 2.42 KB
A Added · cohorts/2023
macros
A Added · 04-analytics-engineering/taxi_rides_ny
README.md 2.03 KB
A Added · cohorts/2023
get_trip_duration_minutes.sql 440 B
A Added · 04-analytics-engineering/taxi_rides_ny/macros
week_1_docker_sql
A Added · cohorts/2023
get_vendor_data.sql 625 B
A Added · 04-analytics-engineering/taxi_rides_ny/macros
homework.md 2.35 KB
A Added · cohorts/2023/week_1_docker_sql
macros_properties.yml 514 B
A Added · 04-analytics-engineering/taxi_rides_ny/macros
week_1_terraform
A Added · cohorts/2023
models
A Added · 04-analytics-engineering/taxi_rides_ny
homework.md 827 B
A Added · cohorts/2023/week_1_terraform
intermediate
A Added · 04-analytics-engineering/taxi_rides_ny/models
week_2_workflow_orchestration
A Added · cohorts/2023
int_trips_unioned.sql 1.37 KB
A Added · 04-analytics-engineering/taxi_rides_ny/models/intermediate
homework.md 4.8 KB
A Added · cohorts/2023/week_2_workflow_orchestration
int_trips.sql 1.69 KB
A Added · 04-analytics-engineering/taxi_rides_ny/models/intermediate
README.md 3.86 KB
A Added · cohorts/2023/week_2_workflow_orchestration
schema.yml 1.53 KB
A Added · 04-analytics-engineering/taxi_rides_ny/models/intermediate
week_3_data_warehouse
A Added · cohorts/2023
marts
A Added · 04-analytics-engineering/taxi_rides_ny/models
homework.md 3.61 KB
A Added · cohorts/2023/week_3_data_warehouse
dim_vendors.sql 230 B
A Added · 04-analytics-engineering/taxi_rides_ny/models/marts
week_4_analytics_engineering
A Added · cohorts/2023
dim_zones.sql 307 B
A Added · 04-analytics-engineering/taxi_rides_ny/models/marts
homework.md 3.42 KB
A Added · cohorts/2023/week_4_analytics_engineering
fct_trips.sql 1.7 KB
A Added · 04-analytics-engineering/taxi_rides_ny/models/marts
week_5_batch_processing
A Added · cohorts/2023
reporting
A Added · 04-analytics-engineering/taxi_rides_ny/models/marts
homework.md 2.31 KB
A Added · cohorts/2023/week_5_batch_processing
fct_monthly_zone_revenue.sql 1.16 KB
A Added · 04-analytics-engineering/taxi_rides_ny/models/marts/reporting
week_6_stream_processing
A Added · cohorts/2023
schema.yml 1.04 KB
A Added · 04-analytics-engineering/taxi_rides_ny/models/marts/reporting
client.properties 364 B
A Added · cohorts/2023/week_6_stream_processing
schema.yml 3.72 KB
A Added · 04-analytics-engineering/taxi_rides_ny/models/marts
homework.md 3.21 KB
A Added · cohorts/2023/week_6_stream_processing
staging
A Added · 04-analytics-engineering/taxi_rides_ny/models
producer_confluent.py 2.38 KB
A Added · cohorts/2023/week_6_stream_processing
schema.yml 4.41 KB
A Added · 04-analytics-engineering/taxi_rides_ny/models/staging
settings.py 859 B
A Added · cohorts/2023/week_6_stream_processing
sources.yml 4.23 KB
A Added · 04-analytics-engineering/taxi_rides_ny/models/staging
spark-submit.sh 581 B
A Added · cohorts/2023/week_6_stream_processing
stg_green_tripdata.sql 1.36 KB
A Added · 04-analytics-engineering/taxi_rides_ny/models/staging
streaming_confluent.py 3.99 KB
A Added · cohorts/2023/week_6_stream_processing
stg_yellow_tripdata.sql 1.35 KB
A Added · 04-analytics-engineering/taxi_rides_ny/models/staging
workshops
A Added · cohorts/2023
package-lock.yml 201 B
A Added · 04-analytics-engineering/taxi_rides_ny
piperider.md 1.76 KB
A Added · cohorts/2023/workshops
packages.yml 111 B
A Added · 04-analytics-engineering/taxi_rides_ny
2024
A Added · cohorts
seeds
A Added · 04-analytics-engineering/taxi_rides_ny
01-docker-terraform
A Added · cohorts/2024
seeds_properties.yml 858 B
A Added · 04-analytics-engineering/taxi_rides_ny/seeds
homework.md 3.66 KB
A Added · cohorts/2024/01-docker-terraform
snapshots
A Added · 04-analytics-engineering/taxi_rides_ny
solutions.md 3.2 KB
A Added · cohorts/2024/01-docker-terraform
.gitkeep 0 B
A Added · 04-analytics-engineering/taxi_rides_ny/snapshots
02-workflow-orchestration
A Added · cohorts/2024
tests
A Added · 04-analytics-engineering/taxi_rides_ny
homework.md 3.41 KB
A Added · cohorts/2024/02-workflow-orchestration
.gitkeep 0 B
A Added · 04-analytics-engineering/taxi_rides_ny/tests
README.md 9.51 KB
A Added · cohorts/2024/02-workflow-orchestration
05-batch
A Added · .
03-data-warehouse
A Added · cohorts/2024
.gitignore 0 B
A Added · 05-batch
homework.md 3.6 KB
A Added · cohorts/2024/03-data-warehouse
code
A Added · 05-batch
04-analytics-engineering
A Added · cohorts/2024
03_test.ipynb 7.67 KB
A Added · 05-batch/code
homework.md 3.28 KB
A Added · cohorts/2024/04-analytics-engineering
04_pyspark.ipynb 18.05 KB
A Added · 05-batch/code
05-batch
A Added · cohorts/2024
05_taxi_schema.ipynb 32.32 KB
A Added · 05-batch/code
homework.md 2.1 KB
A Added · cohorts/2024/05-batch
06_spark_sql_big_query.py 2.59 KB
A Added · 05-batch/code
06-streaming
A Added · cohorts/2024
06_spark_sql.ipynb 8.61 KB
A Added · 05-batch/code
docker-compose.yml 865 B
A Added · cohorts/2024/06-streaming
06_spark_sql.py 2.49 KB
A Added · 05-batch/code
homework.md 7.97 KB
A Added · cohorts/2024/06-streaming
07_groupby_join.ipynb 7.54 KB
A Added · 05-batch/code
leaderboard.md 40.29 KB
A Added · cohorts/2024
08_rdds.ipynb 11.1 KB
A Added · 05-batch/code
project.md 1.49 KB
A Added · cohorts/2024
09_spark_gcs.ipynb 4.26 KB
A Added · 05-batch/code
README.md 1.34 KB
A Added · cohorts/2024
cloud.md 3.78 KB
A Added · 05-batch/code
workshops
A Added · cohorts/2024
download_data.sh 544 B
A Added · 05-batch/code
dlt_resources
A Added · cohorts/2024/workshops
homework.ipynb 16 KB
A Added · 05-batch/code
data_ingestion_workshop.md 26.7 KB
A Added · cohorts/2024/workshops/dlt_resources
README.md 6 KB
A Added · 05-batch
homework_solution.ipynb 50.71 KB
A Added · cohorts/2024/workshops/dlt_resources
setup
A Added · 05-batch
homework_starter.ipynb 7.03 KB
A Added · cohorts/2024/workshops/dlt_resources
config
A Added · 05-batch/setup
incremental_loading.png 25.65 KB
A Added · cohorts/2024/workshops/dlt_resources
core-site.xml 661 B
A Added · 05-batch/setup/config
workshop.ipynb 10.74 MB
A Added · cohorts/2024/workshops/dlt_resources
spark-defaults.conf 161 B
A Added · 05-batch/setup/config
dlt.md 6.65 KB
A Added · cohorts/2024/workshops
spark.dockerfile 23 B
A Added · 05-batch/setup/config
rising-wave.md 6.34 KB
A Added · cohorts/2024/workshops
hadoop-yarn.md 3.29 KB
A Added · 05-batch/setup
2025
A Added · cohorts
linux.md 1.57 KB
A Added · 05-batch/setup
01-docker-terraform
A Added · cohorts/2025
macos.md 3.3 KB
A Added · 05-batch/setup
homework.md 4.83 KB
A Added · cohorts/2025/01-docker-terraform
pyspark.md 1.55 KB
A Added · 05-batch/setup
02-workflow-orchestration
A Added · cohorts/2025
windows.md 3.52 KB
A Added · 05-batch/setup
flows
A Added · cohorts/2025/02-workflow-orchestration
06-streaming
A Added · .
01_getting_started_data_pipeline.yaml 1.38 KB
A Added · cohorts/2025/02-workflow-orchestration/flows
.gitignore 10 B
A Added · 06-streaming
02_postgres_taxi_scheduled.yaml 11.61 KB
A Added · cohorts/2025/02-workflow-orchestration/flows
java
A Added · 06-streaming
02_postgres_taxi.yaml 11.51 KB
A Added · cohorts/2025/02-workflow-orchestration/flows
kafka_examples
A Added · 06-streaming/java
03_postgres_dbt.yaml 1.91 KB
A Added · cohorts/2025/02-workflow-orchestration/flows
.gitignore 143 B
A Added · 06-streaming/java/kafka_examples
04_gcp_kv.yaml 630 B
A Added · cohorts/2025/02-workflow-orchestration/flows
build
A Added · 06-streaming/java/kafka_examples
05_gcp_setup.yaml 602 B
A Added · cohorts/2025/02-workflow-orchestration/flows
build.gradle 1.03 KB
A Added · 06-streaming/java/kafka_examples
06_gcp_taxi_scheduled.yaml 18.7 KB
A Added · cohorts/2025/02-workflow-orchestration/flows
generated-main-avro-java
A Added · 06-streaming/java/kafka_examples/build
06_gcp_taxi.yaml 18.7 KB
A Added · cohorts/2025/02-workflow-orchestration/flows
schemaregistry
A Added · 06-streaming/java/kafka_examples/build/generated-main-avro-java
07_gcp_dbt.yaml 2.01 KB
A Added · cohorts/2025/02-workflow-orchestration/flows
RideRecord.java 14.25 KB
A Added · 06-streaming/java/kafka_examples/build/generated-main-avro-java/schemaregistry
homework.md 3.46 KB
A Added · cohorts/2025/02-workflow-orchestration
RideRecordCompatible.java 17.55 KB
A Added · 06-streaming/java/kafka_examples/build/generated-main-avro-java/schemaregistry
images
A Added · cohorts/2025/02-workflow-orchestration
RideRecordNoneCompatible.java 14.72 KB
A Added · 06-streaming/java/kafka_examples/build/generated-main-avro-java/schemaregistry
homework.png 715.85 KB
A Added · cohorts/2025/02-workflow-orchestration/images
gradle
A Added · 06-streaming/java/kafka_examples
README.md 22.22 KB
A Added · cohorts/2025/02-workflow-orchestration
wrapper
A Added · 06-streaming/java/kafka_examples/gradle
03-data-warehouse
A Added · cohorts/2025
gradle-wrapper.jar 59.33 KB
A Added · 06-streaming/java/kafka_examples/gradle/wrapper
DLT_upload_to_GCP.ipynb 6.18 KB
A Added · cohorts/2025/03-data-warehouse
gradle-wrapper.properties 202 B
A Added · 06-streaming/java/kafka_examples/gradle/wrapper
homework.md 5.1 KB
A Added · cohorts/2025/03-data-warehouse
gradlew 8 KB
A Added · 06-streaming/java/kafka_examples
load_yellow_taxi_data.py 3.58 KB
A Added · cohorts/2025/03-data-warehouse
gradlew.bat 2.77 KB
A Added · 06-streaming/java/kafka_examples
04-analytics-engineering
A Added · cohorts/2025
settings.gradle 133 B
A Added · 06-streaming/java/kafka_examples
homework_q2.png 281.38 KB
A Added · cohorts/2025/04-analytics-engineering
src
A Added · 06-streaming/java/kafka_examples
homework.md 10.28 KB
A Added · cohorts/2025/04-analytics-engineering
main
A Added · 06-streaming/java/kafka_examples/src
05-batch
A Added · cohorts/2025
avro
A Added · 06-streaming/java/kafka_examples/src/main
homework.md 1.88 KB
A Added · cohorts/2025/05-batch
rides_compatible.avsc 354 B
A Added · 06-streaming/java/kafka_examples/src/main/avro
06-streaming
A Added · cohorts/2025
rides_non_compatible.avsc 274 B
A Added · 06-streaming/java/kafka_examples/src/main/avro
homework
A Added · cohorts/2025/06-streaming
rides.avsc 268 B
A Added · 06-streaming/java/kafka_examples/src/main/avro
homework.md 4.42 KB
A Added · cohorts/2025/06-streaming
java
A Added · 06-streaming/java/kafka_examples/src/main
homework.ipynb 27.99 KB
A Added · cohorts/2025/06-streaming/homework
org
A Added · 06-streaming/java/kafka_examples/src/main/java
project.md 1.48 KB
A Added · cohorts/2025
example
A Added · 06-streaming/java/kafka_examples/src/main/java/org
README.md 1.28 KB
A Added · cohorts/2025
AvroProducer.java 3.26 KB
A Added · 06-streaming/java/kafka_examples/src/main/java/org/example
workshops
A Added · cohorts/2025
customserdes
A Added · 06-streaming/java/kafka_examples/src/main/java/org/example
dlt
A Added · cohorts/2025/workshops
CustomSerdes.java 1.61 KB
A Added · 06-streaming/java/kafka_examples/src/main/java/org/example/customserdes
data_ingestion_workshop.md 40.02 KB
A Added · cohorts/2025/workshops/dlt
data
A Added · 06-streaming/java/kafka_examples/src/main/java/org/example
dlt_homework.md 3.08 KB
A Added · cohorts/2025/workshops/dlt
PickupLocation.java 396 B
A Added · 06-streaming/java/kafka_examples/src/main/java/org/example/data
img
A Added · cohorts/2025/workshops/dlt
Ride.java 1.78 KB
A Added · 06-streaming/java/kafka_examples/src/main/java/org/example/data
dlt.png 582.21 KB
A Added · cohorts/2025/workshops/dlt/img
VendorInfo.java 540 B
A Added · 06-streaming/java/kafka_examples/src/main/java/org/example/data
pipes.jpg 156.29 KB
A Added · cohorts/2025/workshops/dlt/img
JsonConsumer.java 2.43 KB
A Added · 06-streaming/java/kafka_examples/src/main/java/org/example
Rest_API.png 131.39 KB
A Added · cohorts/2025/workshops/dlt/img
JsonKStream.java 2.4 KB
A Added · 06-streaming/java/kafka_examples/src/main/java/org/example
README.md 6.12 KB
A Added · cohorts/2025/workshops/dlt
JsonKStreamJoins.java 3.9 KB
A Added · 06-streaming/java/kafka_examples/src/main/java/org/example
dynamic_load_dlt.py 4.44 KB
A Added · cohorts/2025/workshops
JsonKStreamWindow.java 2.56 KB
A Added · 06-streaming/java/kafka_examples/src/main/java/org/example
2026
A Added · cohorts
JsonProducer.java 2.7 KB
A Added · 06-streaming/java/kafka_examples/src/main/java/org/example
01-docker-terraform
A Added · cohorts/2026
JsonProducerPickupLocation.java 2.13 KB
A Added · 06-streaming/java/kafka_examples/src/main/java/org/example
homework.md 5.67 KB
A Added · cohorts/2026/01-docker-terraform
Secrets.java 419 B
A Added · 06-streaming/java/kafka_examples/src/main/java/org/example
02-workflow-orchestration
A Added · cohorts/2026
Topics.java 243 B
A Added · 06-streaming/java/kafka_examples/src/main/java/org/example
homework.md 3.43 KB
A Added · cohorts/2026/02-workflow-orchestration
resources
A Added · 06-streaming/java/kafka_examples/src/main
03-data-warehouse
A Added · cohorts/2026
rides.csv 23.95 KB
A Added · 06-streaming/java/kafka_examples/src/main/resources
homework.md 5.11 KB
A Added · cohorts/2026/03-data-warehouse
test
A Added · 06-streaming/java/kafka_examples/src
04-analytics-engineering
A Added · cohorts/2026
java
A Added · 06-streaming/java/kafka_examples/src/test
homework.md 10.29 KB
A Added · cohorts/2026/04-analytics-engineering
Quick Actions
Commit Information
Hash:
2efcc4a9943c
Commit ID:
45
Created:
2026-01-19 07:16:10
Age:
Jan 19, 2026
Repository:
data-engineering-zoomcamp
Total Files:
456
Download Options
Share
Tweet Email