Skip to content

atf: add null to type of non-key fields #219

@mdibaiee

Description

@mdibaiee

It happens a lot that from SaaS connectors, we have fields that end up as null under specific circumstances.

We are considering marking all properties as nullable by adding null to their type if they are not a key. For keys we don't want to make them nullable.

This can be done using traverse_jsonschema and getting a list of primary keys, and then adding null to type of every non-primary-key field. A simple example usage of traverse_jsonschema: https://github.com/estuary/airbyte/blob/master/airbyte-to-flow/src/interceptors/fix_document_schema.rs#L197-L210

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions