Download fail for large number of issues

[pavelbinar]

When trying to download 3000+ issues, the downloader fails and do not save any of the already requested issues.

$ node app.js https://github.com/lodash/lodash
username:
password:
Requesting API...https://api.github.com/repos/lodash/lodash/issues?state=all&per_page=100&page=1
Successfully requested 1. page of 43
Requesting API...https://api.github.com/repositories/3955647/issues?state=all&per_page=100&page=2
Successfully requested 2. page of 43
Requesting API...https://api.github.com/repositories/3955647/issues?state=all&per_page=100&page=3
Successfully requested 3. page of 43
Requesting API...https://api.github.com/repositories/3955647/issues?state=all&per_page=100&page=4
Successfully requested 4. page of 43
Requesting API...https://api.github.com/repositories/3955647/issues?state=all&per_page=100&page=5
Successfully requested 5. page of 43
Requesting API...https://api.github.com/repositories/3955647/issues?state=all&per_page=100&page=6
Successfully requested 6. page of 43
Requesting API...https://api.github.com/repositories/3955647/issues?state=all&per_page=100&page=7
Successfully requested 7. page of 43
Requesting API...https://api.github.com/repositories/3955647/issues?state=all&per_page=100&page=8
Successfully requested 8. page of 43
Requesting API...https://api.github.com/repositories/3955647/issues?state=all&per_page=100&page=9
Successfully requested 9. page of 43
Requesting API...https://api.github.com/repositories/3955647/issues?state=all&per_page=100&page=10
Successfully requested 10. page of 43
Requesting API...https://api.github.com/repositories/3955647/issues?state=all&per_page=100&page=11
Successfully requested 11. page of 43
Requesting API...https://api.github.com/repositories/3955647/issues?state=all&per_page=100&page=12
Successfully requested 12. page of 43
Requesting API...https://api.github.com/repositories/3955647/issues?state=all&per_page=100&page=13
Successfully requested 13. page of 43
Requesting API...https://api.github.com/repositories/3955647/issues?state=all&per_page=100&page=14
Successfully requested 14. page of 43
Requesting API...https://api.github.com/repositories/3955647/issues?state=all&per_page=100&page=15
Successfully requested 15. page of 43
Requesting API...https://api.github.com/repositories/3955647/issues?state=all&per_page=100&page=16
Successfully requested 16. page of 43
Requesting API...https://api.github.com/repositories/3955647/issues?state=all&per_page=100&page=17
Successfully requested 17. page of 43
Requesting API...https://api.github.com/repositories/3955647/issues?state=all&per_page=100&page=18
Successfully requested 18. page of 43
Requesting API...https://api.github.com/repositories/3955647/issues?state=all&per_page=100&page=19
Successfully requested 19. page of 43
Requesting API...https://api.github.com/repositories/3955647/issues?state=all&per_page=100&page=20
Successfully requested 20. page of 43
Requesting API...https://api.github.com/repositories/3955647/issues?state=all&per_page=100&page=21
Successfully requested 21. page of 43
Requesting API...https://api.github.com/repositories/3955647/issues?state=all&per_page=100&page=22
Successfully requested 22. page of 43
Requesting API...https://api.github.com/repositories/3955647/issues?state=all&per_page=100&page=23
Successfully requested 23. page of 43
Requesting API...https://api.github.com/repositories/3955647/issues?state=all&per_page=100&page=24
Successfully requested 24. page of 43
Requesting API...https://api.github.com/repositories/3955647/issues?state=all&per_page=100&page=25
Successfully requested 25. page of 43
Requesting API...https://api.github.com/repositories/3955647/issues?state=all&per_page=100&page=26
Successfully requested 26. page of 43
Requesting API...https://api.github.com/repositories/3955647/issues?state=all&per_page=100&page=27
Successfully requested 27. page of 43
Requesting API...https://api.github.com/repositories/3955647/issues?state=all&per_page=100&page=28
Successfully requested 28. page of 43
Requesting API...https://api.github.com/repositories/3955647/issues?state=all&per_page=100&page=29
Successfully requested 29. page of 43
Requesting API...https://api.github.com/repositories/3955647/issues?state=all&per_page=100&page=30
Successfully requested 30. page of 43
Requesting API...https://api.github.com/repositories/3955647/issues?state=all&per_page=100&page=31
Successfully requested 31. page of 43
Requesting API...https://api.github.com/repositories/3955647/issues?state=all&per_page=100&page=32
Successfully requested 32. page of 43
Requesting API...https://api.github.com/repositories/3955647/issues?state=all&per_page=100&page=33
Successfully requested 33. page of 43
Requesting API...https://api.github.com/repositories/3955647/issues?state=all&per_page=100&page=34
Successfully requested 34. page of 43
Requesting API...https://api.github.com/repositories/3955647/issues?state=all&per_page=100&page=35
Successfully requested 35. page of 43
Requesting API...https://api.github.com/repositories/3955647/issues?state=all&per_page=100&page=36

Repository have 0 issues. Nothing to download

[Beenish123]

Yeah, Same issue faced by me. After some time it stops by giving me message 0 issues found.

[pavelbinar]

@Beenish123 Hi, can you provide me more info which would be helpful for the issue reproduction?

What version of downloader do you use?
What repository did you try to download?
Is the repository private or public?
Do you use two-factor authorization?
What is your OS?

Thanks.

[Beenish123]

Im using npm 12.14.1LTS and I have tried microsoft/recommenders repo for extracting issues. Im using windows.

[Beenish123]

And yes when I

tried to extract remoteorigin/git-issues-downloader it worked well.

[pavelbinar]

I am looking into that...

In meanwhile, this is what you need, right? :)
all_issues.csv.zip

What version of downloader do you use?
run: git-issues-downloader --version

[pavelbinar]

All right. I just pushed a new release 0.1.4 fixing some issues.

Please install the latest version and try again:

npm install -g git-issues-downloader

Your repository is not private so you do not need to use username and password so just hit enter once program asks for username and password.

git-issues-downloader https://github.com/microsoft/recommenders

Let me know if that works.