You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
|[Orchestration (Apache Airflow)](https://github.com/Data-Bishop/Team5-BuildItAll-Data-Platform/tree/main/orchestration)| Manages data pipeline workflows |
26
-
|[Spark jobs (PySpark)](https://github.com/Data-Bishop/Team5-BuildItAll-Data-Platform/tree/main/spark_jobs)| Simulates realistic e-commerce datasets and processing |
23
+
|[CI/CD (GitHub Actions)](https://github.com/Data-Bishop/Team5-BuildItAll-Data-Platform/blob/main/docs/codebase_and_ci_cd.md)| Automates code deployment and infrastructure updates |
|[Orchestration (Apache Airflow)](https://github.com/Data-Bishop/Team5-BuildItAll-Data-Platform/blob/main/docs/airflow_documentation.md)| Manages data pipeline workflows |
26
+
|[Spark jobs (PySpark)](https://github.com/Data-Bishop/Team5-BuildItAll-Data-Platform/blob/main/docs/spark_jobs.md)| Simulates realistic e-commerce datasets and processing |
27
27
28
28
## ☁️ Architecture Overview
29
29

30
30
Clear [architecture documentation](https://github.com/Data-Bishop/Team5-BuildItAll-Data-Platform/blob/main/docs/architecture.md) outlining the platform’s design.
31
31
32
+
For Architecture documentation[ Click here](https://github.com/Data-Bishop/Team5-BuildItAll-Data-Platform/blob/main/docs/architecture.md)
32
33
33
34
## 🛠️ Technologies Used
34
35
- Cloud: AWS (S3, IAM)
@@ -77,4 +78,3 @@ Clear separation between raw and processed data zones in AWS S3, following data
77
78
- Comprehensive [documentations](https://github.com/Data-Bishop/Team5-BuildItAll-Data-Platform/tree/main/docs) to support onboarding, repository cloning, and commercial deployment.
Copy file name to clipboardExpand all lines: docs/codebase_and_ci_cd.md
+2-2Lines changed: 2 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -2,7 +2,7 @@
2
2
3
3
## **1. Repository Structure**
4
4
The repository is organized into directories and files that represent the different components of the **BuildItAll Data Platform**. Below is an overview of the structure:
5
-
5
+
```graphql
6
6
BuildItAll_Data_Platform/
7
7
├── .github/
8
8
│ └── workflows/ # GitHub Actions workflows for CI/CD
@@ -45,7 +45,7 @@ BuildItAll_Data_Platform/
45
45
│ ├── requirements.txt # Python dependencies for Spark jobs
46
46
│ ├── bootstrap.sh # Bootstrap script for EMR cluster
0 commit comments