Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Python library to simplify the interaction with dim #82

Open
lisphilar opened this issue Oct 2, 2022 · 5 comments
Open

Python library to simplify the interaction with dim #82

lisphilar opened this issue Oct 2, 2022 · 5 comments

Comments

@lisphilar
Copy link

Thank you for creating this project :)
Data installation manager is absolutely required for open source community. I faced some difficulties when developing a dataset and a data analysis tool with Python regarding COVID-19.

Is it possible to add Python (+R?) library to simplify the interaction with dim?
(I'm not sure we can call Deno from Python...)
Users may use the new library as follows.

  1. Install the library, like poetry add dim-python
  2. Write settings on "pyproject.toml" with commands. This TOML format file is the standard Python library management file currently.
[tool.dim]
directory = './data_files'
datasets = [
    {
        name = 'example',
        url = 'https://example.com',
        unzip = true,
        forced = true,
        encoding = 'utf-8',
        postprocess = ["poetry run python ./tests/test_custom_command.py",],
    },
]
  1. Update datasets with poetry run dim update, or

  2. Update/load the dataset with Python scripts.

import dim
dim.config(settings='./data_files/dim-lock.json')
data = dim.load(name='example')

I'm just a new user, but very interested in this project.

@ryo-ma
Copy link
Collaborator

ryo-ma commented Oct 2, 2022

Thank you for your interest.
I am planning to support the execution of dim from the library.

If you are interested, would you like to develop dim together?
Just getting your opinion is fine.
I want to grow this open source together!

@lisphilar
Copy link
Author

Many thanks for your positive response!
I will be happy to join this project as a developer.

@ryo-ma
Copy link
Collaborator

ryo-ma commented Oct 3, 2022

I am trying to develop dim as an open community.
I already have Slack channel, so please join if you can participate. I would like to communicate on Slack.

https://join.slack.com/t/c3lab-hq/shared_invite/zt-v6zz66n9-1VYkVXC4zoQViWSMdzMTLg

@lisphilar
Copy link
Author

@ryo-ma
Thank you for the invitation for Slack. I successfully join to the Slack team.
This issue is still open to record the status of the library development.

@ryo-ma
Copy link
Collaborator

ryo-ma commented Oct 4, 2022

I have created a repository.
https://github.com/c-3lab/dim-python

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants