Skip to content

Data loader for JSON #70

@garlontas

Description

@garlontas

JSON data loader

Currently, we have a data loader for CSV files. It works by converting each data set (each row) to a namedtuple.

We need sth similar for JSON. Note that type conversion should be done as efficient as possible (see issue #63 for more information).

The loader should also handle non-consistent data, such as the JSON below:

[
  {
    "name": "Joe Doe",
    "position": "Vice President",
    "children": [
      {
        "name": "Jim Doe"
      },
      {
        "name": "Kim Doe"
      }
    ]
  },
  {
    "class": "Mammalia",
    "order": "Carnivora",
    "family": "Canidae",
    "genus": "Canis"
  }
]

Here, a LazyFileIterable containing two differently structured namedtuples should be created.

You can view the implementation for CSV here.

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions