Skip to content

Commit

Permalink
Remove | uniq when getting scrapers
Browse files Browse the repository at this point in the history
There should only ever be unique results based
on the filenames and this was leading to 1 exit codes
  • Loading branch information
k-nut committed Apr 17, 2024
1 parent 3b8f564 commit 49036df
Showing 1 changed file with 1 addition and 2 deletions.
3 changes: 1 addition & 2 deletions test_changes.sh
Original file line number Diff line number Diff line change
Expand Up @@ -16,8 +16,7 @@ CHANGED_SCRAPERS=$(git whatchanged --name-only --pretty="" origin/master..${HEAD
grep -v helper |
sed 's/jedeschule\/spiders\///' |
sed 's/\.py//' |
sed 's/_/\-/' |
uniq)
sed 's/_/\-/')

for SPIDER in $CHANGED_SCRAPERS
do
Expand Down

0 comments on commit 49036df

Please sign in to comment.