[File system] Add Tencent Cloud COS integration

[XuQianJin-Stars]

Search before asking

• I searched in the issues and found nothing similar.

Motivation

Add support for Tencent Cloud COS (Cloud Object Storage) file system integration to Fluss.

Solution

Integrate Tencent Cloud COS Hadoop file system adapter class. Configuration options will be passed directly to the COS file system.

Configuration Example

remote.data.dir: cosn://bucket/fluss
'fs.cosn.endpoint' = 'ap-guangzhou',
'fs.cosn.userinfo.secretId' = 'your-secret-id',
'fs.cosn.userinfo.secretKey' = 'your-secret-key'

Implementation Plan

1. Create fluss-fs-cos module under fluss-filesystems/
2. Add Maven dependencies:
   • org.apache.hadoop:hadoop-cos
   • com.qcloud:cos_api
3. Implement CosFileSystemFactory (similar to OssFileSystemFactory and ObsFileSystemFactory)
4. Add plugin service loader configuration
5. Implement credential/token provider if needed
6. Add unit tests and integration tests

Testing

Local testing can be done with environment variables:

• COSN_SECRET_ID
• COSN_SECRET_KEY
• COSN_ENDPOINT
• COSN_BUCKET

References

• Tencent Cloud COS: https://cloud.tencent.com/document/product/436
• Hadoop-COS: https://cloud.tencent.com/document/product/436/6884
• GitHub: https://github.com/tencentyun/hadoop-cos

Benefits

• Enables Fluss users to use Tencent Cloud COS as remote storage
• Expands cloud provider support for Chinese market
• Consistent with existing file system plugin architecture

Anything else?

No response

Willingness to contribute

• I'm willing to submit a PR!