https://github.com/aws/aws-sdk-pandas

amazon-athena amazon-sagemaker-notebook apache-arrow apache-parquet athena aws aws-glue aws-lambda data-engineering data-science emr etl glue-catalog lambda modin mysql pandas python ray redshift

Last synced: about 1 month ago

Repository metadata:

pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).

Host: GitHub
URL: https://github.com/aws/aws-sdk-pandas
Owner: aws
License: apache-2.0
Created: 2019-02-26T01:39:02.000Z (almost 6 years ago)
Default Branch: main
Last Pushed: 2024-11-04T15:37:19.000Z (about 2 months ago)
Last Synced: 2024-11-05T21:03:06.810Z (about 2 months ago)
Topics: amazon-athena, amazon-sagemaker-notebook, apache-arrow, apache-parquet, athena, aws, aws-glue, aws-lambda, data-engineering, data-science, emr, etl, glue-catalog, lambda, modin, mysql, pandas, python, ray, redshift
Language: Python
Homepage: https://aws-sdk-pandas.readthedocs.io
Size: 15 MB
Stars: 3,926
Watchers: 60
Forks: 698
Open Issues: 38
Metadata Files:
- Readme: README.md
- Contributing: CONTRIBUTING.md
- License: LICENSE.txt
- Code of conduct: CODE_OF_CONDUCT.md

Owner metadata:

Name: Amazon Web Services
Login: aws
Email:
Kind: organization
Description:
Website: https://amazon.com/aws
Location: Seattle, WA
Twitter:
Company:
Icon url: https://avatars.githubusercontent.com/u/2232217?v=4
Repositories: 386
Last Synced at: 2023-04-09T04:55:29.170Z
Profile URL: https://github.com/aws
Sponsor URL:

Committers metadata

Last synced: about 1 month ago

Total Commits: 2,312
Total Committers: 167
Avg Commits per committer: 13.844
Development Distribution Score (DDS): 0.607

Commits in past year: 284
Committers in past year: 32
Avg Commits per committer in past year: 8.875
Development Distribution Score (DDS) in past year: 0.62

Name	Email	Commits
igorborgest	i**t@g**m	908
jaidisido	j**o@g**m	332
Leon Luttenberger	L****r	212
dependabot[bot]	4****]	143
kukushking	3****g	107
Lucas Hanson	l**n@g**m	105
kukushking	k**n@g**m	104
Leon Luttenberger	l**n@g**m	43
Maximilian	3****r	32
Bryan	k**8@g**m	26
Luigi Tedesco	l**c@a**m	24
Cyril Fait	9****t	21
Cyril Fait	c**t@m**o	19
Patrick Muller	p**r@o**m	12
Henri Yandell	h****l	7
Flavio Altinier	f**r@p**l	7
Nick Corbett	n**t@g**m	6
KhueNgocDang	6****g	5
donghan	d**g@i**m	5
Tulio Casagrande	t**e@g**m	5
Brannon Imamura	b**a@u**m	4
JPFrancoia	j**a@o**i	4
William Smith	w**h@t**m	4
nicholas-miles	n**6@g**m	3
Jeroen Schot	j**t@o**i	3
Daniel Wood	w**w@a**m	3
Brian Schroeder	b**n@s**m	3
bechbd	b****d	3
Robert Schmidtke	r****e	3
Álvaro Ponce Cabrera	a**3@g**m	2
and 137 more...

Issue and Pull Request metadata

Last synced: about 1 month ago

Package metadata

Total packages: 2
Total downloads:
- pypi: 51,689,222 last-month
Total docker downloads: 20,925
Total dependent packages: 44 (may contain duplicates)
Total dependent repositories: 186 (may contain duplicates)
Total versions: 236
Total maintainers: 5

pypi: awswrangler

Pandas on AWS.

Homepage: https://aws-sdk-pandas.readthedocs.io/
Documentation: https://aws-sdk-pandas.readthedocs.io/
Licenses: Apache-2.0
Latest release: 3.7.3 (published 8 months ago)
Last Synced: 2024-11-10T23:36:59.333Z (about 1 month ago)
Versions: 155
Dependent Packages: 44
Dependent Repositories: 185
Downloads: 51,689,222 Last month
Docker Downloads: 20,925
Rankings:
- Downloads: 0.028%
- Dependent packages count: 0.341%
- Dependent repos count: 1.088%
- Average: 1.24%
- Docker downloads count: 1.76%
- Stargazers count: 1.778%
- Forks count: 2.444%
Maintainers (5)

conda: awswrangler

An open-source Python package that extends the power of Pandas library to AWS connecting DataFrames and AWS data related services. Easy integration with Athena, Redshift, Glue, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL). Built on top of other open-source projects like Pandas, Apache Arrow and Boto3, it offers abstracted functions to execute usual ETL tasks like load/unload data from Data Lakes, Data Warehouses and Databases.

Homepage: https://aws-sdk-pandas.readthedocs.io
Licenses: Apache-2.0
Latest release: 2.17.0 (published about 2 years ago)
Last Synced: 2024-11-10T23:38:50.741Z (about 1 month ago)
Versions: 81
Dependent Packages: 0
Dependent Repositories: 1
Rankings:
- Forks count: 6.747%
- Stargazers count: 6.931%
- Average: 22.405%
- Dependent repos count: 24.353%
- Dependent packages count: 51.589%

Dependencies

.github/workflows/bandit.yml actions

actions/checkout v3 composite
actions/setup-python v4 composite

.github/workflows/cfn-nag.yml actions

actions/cache v3 composite
actions/checkout v3 composite
actions/setup-node v3 composite
actions/setup-python v4 composite
stelligent/cfn_nag master composite

.github/workflows/check-pytest-xfails.yml actions

actions/checkout v3 composite

.github/workflows/git-hygiene.yml actions

actions/stale v4 composite

.github/workflows/minimal-tests.yml actions

actions/checkout v3 composite
actions/setup-python v4 composite

.github/workflows/minimum-response-time.yml actions

malachi-constant/issue-minimum-response latest composite

.github/workflows/pr-linter.yml actions

aslafy-z/conventional-pr-title-action v3 composite

.github/workflows/snyk.yml actions

actions/checkout master composite
snyk/actions/python-3.8 master composite

.github/workflows/static-checking.yml actions

actions/checkout v3 composite
actions/setup-python v4 composite

.github/workflows/unlabel-assigned-issue.yml actions

andymckay/labeler master composite

building/lambda/Dockerfile docker

${base_image} latest build
${python_version} latest build

docs/environment.yml pypi

IPython *
myst_parser *
nbsphinx *
nbsphinx-link *
sphinx *
sphinx-copybutton *
sphinx_bootstrap_theme *

poetry.lock pypi

269 dependencies

pyproject.toml pypi

IPython ^8.10.0 develop
black ^23.1.0 develop
boto3-stubs ^1.26.151 develop
bump2version ^1.0.1 develop
doc8 ^1.0 develop
flake8 ^5.0.1 develop
isort ^5.9.2 develop
jupyterlab ^3.0 develop
moto ^4.1 develop
mypy ^1.0 develop
myst-parser ^1.0.0 develop
nbsphinx ^0.8.8 develop
nbsphinx-link ^1.3.0 develop
openpyxl ^3.0 develop
pydocstyle ^6.1.1 develop
pydot ^1.4.2 develop
pylint ^2.17 develop
pyparsing ^3.0.7 develop
pytest ^7.1.2 develop
pytest-cov ^4.0 develop
pytest-rerunfailures ^11.1 develop
pytest-timeout ^2.1.0 develop
pytest-xdist ^3.0.2 develop
ruff ^0.0.270 develop
s3fs 0.4.2 develop
setuptools * develop
sphinx ^6.0 develop
sphinx-bootstrap-theme ^0.8 develop
sphinx-copybutton ^0.5.1 develop
tox ^4.5.0 develop
wheel ^0.38.1 develop
SPARQLWrapper ^2.0.0
boto3 ^1.20.32
botocore ^1.23.32
deltalake >=0.6.4,<0.11.0
geopandas ^0.13.2
gremlinpython ^3.6.2
jsonpath-ng ^1.5.3
modin ^0.23.0
numpy ^1.18
openpyxl ^3.0.0
opensearch-py ^2.0.0
oracledb ^1.0.0
packaging >=21.1,<24.0
pandas >=1.2.0,<3.0.0
pg8000 ^1.29.0
progressbar2 ^4.0.0
pyarrow >=7.0.0
pymysql ^1.0.0
pyodbc ^4.0.0
python >=3.8, <4.0
ray >=2.0.0,<2.7.0
redshift-connector ^2.0.0
requests ^2.0.0
requests-aws4auth ^1.1.1
typing-extensions ^4.4.0

test_infra/poetry.lock pypi

attrs 23.1.0
aws-cdk-asset-awscli-v1 2.2.200
aws-cdk-asset-kubectl-v20 2.1.2
aws-cdk-asset-node-proxy-agent-v5 2.0.165
aws-cdk-aws-glue-alpha 2.87.0a0
aws-cdk-aws-neptune-alpha 2.87.0a0
aws-cdk-aws-redshift-alpha 2.87.0a0
aws-cdk-lib 2.87.0
cattrs 23.1.2
constructs 10.2.69
exceptiongroup 1.1.2
importlib-metadata 6.7.0
importlib-resources 5.12.0
jsii 1.84.0
publication 0.0.3
python-dateutil 2.8.2
six 1.16.0
typeguard 2.13.3
typing-extensions 4.7.1
zipp 3.15.0

test_infra/pyproject.toml pypi

aws-cdk-lib ^2.85.0
aws-cdk.aws-glue-alpha ^2.85.0a0
aws-cdk.aws-neptune-alpha ^2.85.0a0
aws-cdk.aws-redshift-alpha ^2.85.0a0
constructs >=10.0.0,<11.0.0
python >=3.7.1, <4.0