dask-avro

Avro reader for Dask.

by rmax

Star on GitHub Fork

Python

4 stars 1 forks 1 contributorQuiet · 8y agoSince 2017MIT

Meet the team

See all 1 on GitHub →

rmax35 contributions

Languages

View on GitHub →

Python62.4%

Makefile37.6%

Commit activity

Last 12 weeks · 0 commits

Full graph →

Community health

3 of 6 standards met

Community profile →

✓README✓License✓Contributing○Code of Conduct○Issue Template○PR Template

Recent PRs & issues

Quiet · 3 discussions · Last activity 8y ago

See all on GitHub →

Broken link to / or missing documentationOpenIssue

I can't seem to be able to access the documentation here: https://dask-avro.readthedocs.org

jayBana · 6y ago

Is it possible to download from s3?OpenIssue

I am trying to read some data from s3 and it ends up trying to find the file locally.

Bonsanto · 7y ago

Merging into the dask library?OpenIssue

Hi, This seems useful. I was wondering if there's a particular reason it's not being merged into the dask library. Thanks

nirizr · 7y ago

Recent fixes

View closed PRs →

Compatibility with fastavro 0.19.7ClosedIssue

seems to have changed one of their internal methods, , into . This seems to have happened in their latest minor release, from 0.19.6 to 0.19.7, see this commit. So a quick fix is just to install with conda or pip. I'm not very familliar with or , what would be a good solution? Pinning the dependency to Handling it in Relying on public interface instead of internal methods?

The-Fonz · 8y ago

fastavro._reader renamed to fastavro.read._readClosedIssue

I have just installed fastavro, version is 0.17.2. fastavro does not have the attribute used in dask-avro and instead have it named . Changing that name works fine, but otherwise an exception is thrown.

nirizr · 8y ago

Dask_avro cant run with dask 1.17.0ClosedIssue

See following snippet:

nirizr · 8y ago

Structured data for AI agents

Repository: rmax/dask-avro. Description: Avro reader for Dask. Stars: 4, Forks: 1. Primary language: Python. Languages: Python (62.4%), Makefile (37.6%). License: MIT. Open PRs: 0, open issues: 3. Last activity: 8y ago. Community health: 57%. Top contributors: rmax.