https://github.com/piskvorky/smart_open
boto bz2 file gzip-stream hacktoberfest hdfs python s3 streaming streaming-data webhdfs
Last synced: about 1 month ago
Repository metadata:
Utils for streaming large files (S3, HDFS, gzip, bz2...)
- Host: GitHub
- URL: https://github.com/piskvorky/smart_open
- Owner: piskvorky
- License: mit
- Created: 2015-01-02T13:05:52.000Z (almost 10 years ago)
- Default Branch: develop
- Last Pushed: 2024-10-04T13:58:12.000Z (3 months ago)
- Last Synced: 2024-10-29T15:44:44.212Z (about 2 months ago)
- Topics: boto, bz2, file, gzip-stream, hacktoberfest, hdfs, python, s3, streaming, streaming-data, webhdfs
- Language: Python
- Homepage:
- Size: 1.57 MB
- Stars: 3,198
- Watchers: 47
- Forks: 384
- Open Issues: 78
-
Metadata Files:
- Readme: README.rst
- Changelog: CHANGELOG.md
- Contributing: CONTRIBUTING.md
- Funding: .github/FUNDING.yml
- License: LICENSE
-
Funding.yml:
- Github: piskvorky
- Funding Links:
Owner metadata:
- Name: Radim Řehůřek
- Login: piskvorky
- Email:
- Kind: user
- Description: Creator of Gensim, founder and CTO at @RARE-Technologies and pii-tools.com. I love history and beginnings in general.
- Website: https://twitter.com/radimrehurek
- Location: Prague
- Twitter:
- Company: @RARE-Technologies
- Icon url: https://avatars.githubusercontent.com/u/610412?u=457738a74109eba091a4338bb37536609ce0145a&v=4
- Repositories: 59
- Last Synced at: 2024-05-20T15:04:50.650Z
- Profile URL: https://github.com/piskvorky
- Sponsor URL:
Committers metadata
Last synced: about 1 month ago
Total Commits: 922
Total Committers: 131
Avg Commits per committer: 7.038
Development Distribution Score (DDS): 0.717
Commits in past year: 56
Committers in past year: 22
Avg Commits per committer in past year: 2.545
Development Distribution Score (DDS) in past year: 0.554
| Name | Commits | |
|---|---|---|
| Michael Penkov | m@p****v | 261 |
| Michael Penkov | m****v@g****m | 172 |
| Ivan Menshikh | m****v@g****m | 61 |
| Lev Konstantinovskiy | l****t@g****m | 48 |
| Radim Řehůřek | r****k@s****z | 45 |
| Zikes, Jan | j****s@m****m | 27 |
| Michael Penkov | p****v@p****e | 22 |
| Peter | p****1@g****m | 22 |
| Adam Mertz | a****z@g****m | 21 |
| Ivan Menshikh | i****n@z****m | 18 |
| Vincent Kríž | v****z@k****u | 13 |
| ddelange | 1****e | 13 |
| Ivan Menshikh | i****h@e****u | 12 |
| Peter Dannemann | p****n@b****g | 8 |
| Rob Cowie | r****e@m****m | 7 |
| Vadim Markovtsev | v****m@s****h | 6 |
| interpolatio | 3****o | 6 |
| Alexandre Sieira | a****a@g****m | 5 |
| Radim Řehůřek | me@r****m | 5 |
| salilb | s****b@o****m | 5 |
| Philippe Ombredanne | p****e@n****m | 5 |
| Edan Schwartz | e****z@o****m | 4 |
| Matthew Crowson | m****n@g****m | 4 |
| Judah Rand | 1****d | 3 |
| RachitSharma2001 | 4****1 | 3 |
| Adrian Partl | a****n@p****t | 3 |
| John Vandenberg | j****b@g****m | 3 |
| Paul O'Leary McCann | p****m@d****m | 2 |
| inksink | y****g@m****m | 2 |
| Mariusz Kryński | m****k@s****l | 2 |
| and 101 more... | ||
Issue and Pull Request metadata
Last synced: about 1 month ago
Package metadata
- Total packages: 5
-
Total downloads:
- pypi: 32,251,127 last-month
- Total docker downloads: 986,441,609
- Total dependent packages: 252 (may contain duplicates)
- Total dependent repositories: 10,157 (may contain duplicates)
- Total versions: 88
- Total maintainers: 4
pypi: smart-open
Utils for streaming large files (S3, HDFS, GCS, Azure Blob Storage, gzip, bz2...)
- Homepage: https://github.com/piskvorky/smart_open
- Documentation: https://smart-open.readthedocs.io/
- Licenses: MIT
- Latest release: 7.0.4 (published 9 months ago)
- Last Synced: 2024-11-11T00:01:16.429Z (about 1 month ago)
- Versions: 62
- Dependent Packages: 248
- Dependent Repositories: 10,157
- Downloads: 32,251,075 Last month
- Docker Downloads: 986,441,609
-
Rankings:
- Downloads: 0.056%
- Dependent repos count: 0.084%
- Dependent packages count: 0.088%
- Docker downloads count: 0.561%
- Average: 1.058%
- Stargazers count: 1.895%
- Forks count: 3.663%
- Maintainers (2)
pypi: tethys-smart-open
Utils for streaming large files (S3, HDFS, GCS, Azure Blob Storage, gzip, bz2...)
- Homepage: https://github.com/piskvorky/smart_open
- Status: removed
- Documentation: https://tethys-smart-open.readthedocs.io/
- Licenses: MIT
- Latest release: 6.2.0.dev2 (published about 2 years ago)
- Last Synced: 2024-11-11T00:01:21.743Z (about 1 month ago)
- Versions: 3
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent packages count: 4.842%
- Average: 5.587%
- Dependent repos count: 6.331%
go: github.com/piskvorky/smart_open
- Homepage:
- Documentation: https://pkg.go.dev/github.com/piskvorky/smart_open#section-documentation
- Licenses: mit
- Latest release:
- Last Synced: 2024-11-11T00:01:21.721Z (about 1 month ago)
- Versions: 19
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent packages count: 6.456%
- Average: 6.674%
- Dependent repos count: 6.892%
spack: py-smart-open
smart_open is a Python 2 & Python 3 library for efficient streaming of very large files from/to S3, HDFS, WebHDFS, HTTP, or local storage. It supports transparent, on-the-fly (de-)compression for a variety of different formats.
- Homepage: https://github.com/piskvorky/smart_open
- Licenses: []
- Latest release: 5.2.1 (published over 2 years ago)
- Last Synced: 2024-11-11T00:02:33.131Z (about 1 month ago)
- Versions: 3
- Dependent Packages: 4
- Dependent Repositories: 0
-
Rankings:
- Dependent repos count: 0.0%
- Average: 7.093%
- Dependent packages count: 14.186%
- Maintainers (1)
pypi: srcd_smart_open
Utils for streaming large files (S3, HDFS, gzip, bz2...) - temporary source{d} fork
- Homepage: https://github.com/piskvorky/smart_open
- Documentation: https://srcd_smart_open.readthedocs.io/
- Licenses: MIT
- Latest release: 1.9.0 (published almost 6 years ago)
- Last Synced: 2024-11-11T00:00:58.464Z (about 1 month ago)
- Versions: 1
- Dependent Packages: 0
- Dependent Repositories: 0
- Downloads: 52 Last month
-
Rankings:
- Stargazers count: 1.357%
- Forks count: 2.707%
- Dependent packages count: 6.633%
- Average: 11.95%
- Downloads: 18.442%
- Dependent repos count: 30.611%
- Maintainers (1)
Dependencies
- awscli *
- pytest *
- pytest_benchmark *
- actions/checkout v2 composite
- actions/setup-python v2 composite
- actions/checkout v1 composite
- actions/setup-python v1 composite