Description
Collect data from Gitee(Cloud).
Pre-requisites
Please make sure you have access to Gitee API before applying to this issue; otherwise, it's nearly impossible to finish this task.
Describe the solution you'd like
Add a plugin for gitee. Please refer to other data source plugins such as github and gitlab.
This plugin performs 3 major tasks:
- Collect data from Gitee API. The API response will be stored in the raw data layer.
- 1st ETL: transform the raw data and load it into the tool layer.
- 2nd ETL: transform the tool layer data and load it into the domain layer. As Gitee is a source code management and code review tool, the final data to be loaded into the domain layer are mainly entities from source code management domain and code review domain.
How to start
Please follow the doc how to add a plugin(WIP).
Additional notes
In DevLake, there're 3 layers of storage:
- raw data layer: tables starting with
_raw_
- tool layer: tables starting with
_tool_
- domain layer: tables with no prefix
You can set up DevLake and see the tables in MySQL.
Description
Collect data from Gitee(Cloud).
Pre-requisites
Please make sure you have access to Gitee API before applying to this issue; otherwise, it's nearly impossible to finish this task.
Describe the solution you'd like
Add a plugin for
gitee. Please refer to other data source plugins such as github and gitlab.This plugin performs 3 major tasks:
How to start
Please follow the doc how to add a plugin(WIP).
Additional notes
In DevLake, there're 3 layers of storage:
_raw__tool_You can set up DevLake and see the tables in MySQL.