Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Feat/llm fact-checking in ranking based selector #555

Open
wants to merge 38 commits into
base: dev
Choose a base branch
from
Open

Feat/llm fact-checking in ranking based selector #555

wants to merge 38 commits into from
+452 −19

Commits on Aug 10, 2023

  1. first commit

    @smilni
    smilni committed Aug 10, 2023
    Configuration menu
    Copy the full SHA
    0f5e5e8 View commit details
    Browse the repository at this point in the history

  2. fix format of output

    @smilni
    smilni committed Aug 10, 2023
    Configuration menu
    Copy the full SHA
    dd2a93f View commit details
    Browse the repository at this point in the history

  3. fixes

    @smilni
    smilni committed Aug 10, 2023
    Configuration menu
    Copy the full SHA
    02c711e View commit details
    Browse the repository at this point in the history

Commits on Aug 14, 2023

  1. fact-checking annotator, working version

    @smilni
    smilni committed Aug 14, 2023
    Configuration menu
    Copy the full SHA
    16d6f20 View commit details
    Browse the repository at this point in the history

  2. hyp considered incorrect after first contradiction

    @smilni
    smilni committed Aug 14, 2023
    Configuration menu
    Copy the full SHA
    82f98a2 View commit details
    Browse the repository at this point in the history

  3. better logging & not checking some skills

    @smilni
    smilni committed Aug 14, 2023
    Configuration menu
    Copy the full SHA
    c5f0274 View commit details
    Browse the repository at this point in the history

  4. modifying response selector to include fact-checking

    @smilni
    smilni committed Aug 14, 2023
    Configuration menu
    Copy the full SHA
    98f0f20 View commit details
    Browse the repository at this point in the history

Commits on Aug 15, 2023

  1. added default ENABLE_FACT_CHECKING=0 to Dockerfile

    @smilni
    smilni committed Aug 15, 2023
    Configuration menu
    Copy the full SHA
    1fe10da View commit details
    Browse the repository at this point in the history

  2. added default FACTUAL_CONFORMITY_SERVICE_TIMEOUT=0 to Dockerfile

    @smilni
    smilni committed Aug 15, 2023
    Configuration menu
    Copy the full SHA
    0ca6999 View commit details
    Browse the repository at this point in the history

  3. improved logging + minor fixes

    @smilni
    smilni committed Aug 15, 2023
    Configuration menu
    Copy the full SHA
    769dba1 View commit details
    Browse the repository at this point in the history

  4. upd timeout

    @smilni
    smilni committed Aug 15, 2023
    Configuration menu
    Copy the full SHA
    c852ac3 View commit details
    Browse the repository at this point in the history

  5. update README for ranking_based_response_selector by adding fact-chec… 

    …king
    @smilni
    smilni committed Aug 15, 2023
    Configuration menu
    Copy the full SHA
    58d426d View commit details
    Browse the repository at this point in the history

  6. removed or modified obsolete files

    @smilni
    smilni committed Aug 15, 2023
    Configuration menu
    Copy the full SHA
    0b5b157 View commit details
    Browse the repository at this point in the history

  7. test file for fact checking

    @smilni
    smilni committed Aug 15, 2023
    Configuration menu
    Copy the full SHA
    f4c3b6b View commit details
    Browse the repository at this point in the history

  8. moved SKILLS_NOT_TO_FACT_CHECK, updated README for response selector

    @smilni
    smilni committed Aug 15, 2023
    Configuration menu
    Copy the full SHA
    eab1017 View commit details
    Browse the repository at this point in the history

  9. add README.md for annotator

    @smilni
    smilni committed Aug 15, 2023
    Configuration menu
    Copy the full SHA
    11094d1 View commit details
    Browse the repository at this point in the history

  10. code style & moved SKILLS_NOT_TO_FACT_CHECK

    @smilni
    smilni committed Aug 15, 2023
    Configuration menu
    Copy the full SHA
    add0a27 View commit details
    Browse the repository at this point in the history

  11. moving EXTERNAL_SKILLS from args to common

    @smilni
    smilni committed Aug 15, 2023
    Configuration menu
    Copy the full SHA
    0524a72 View commit details
    Browse the repository at this point in the history

  12. moving EXTERNAL_SKILLS from args to common again

    @smilni
    smilni committed Aug 15, 2023
    Configuration menu
    Copy the full SHA
    722d187 View commit details
    Browse the repository at this point in the history

  13. improve logging and make SERVICE_PORT an arg

    @smilni
    smilni committed Aug 15, 2023
    Configuration menu
    Copy the full SHA
    0e7e441 View commit details
    Browse the repository at this point in the history

  14. component cards for annotator

    @smilni
    smilni committed Aug 15, 2023
    Configuration menu
    Copy the full SHA
    fd5943a View commit details
    Browse the repository at this point in the history

  15. component cards for fact-checking annotator and ranking-based-respons… 

    …e-selector-fact-checking
    @smilni
    smilni committed Aug 15, 2023
    Configuration menu
    Copy the full SHA
    a9772b5 View commit details
    Browse the repository at this point in the history

  16. codestyle upd

    @smilni
    smilni committed Aug 15, 2023
    Configuration menu
    Copy the full SHA
    16bec65 View commit details
    Browse the repository at this point in the history

  17. fix typo

    @smilni
    smilni committed Aug 15, 2023
    Configuration menu
    Copy the full SHA
    4b02fe1 View commit details
    Browse the repository at this point in the history

  18. revert accidental change in ranking_based_response_selector/test.py

    @smilni
    smilni committed Aug 15, 2023
    Configuration menu
    Copy the full SHA
    64e9119 View commit details
    Browse the repository at this point in the history

  19. remove debugging in dp_formatters

    @smilni
    smilni committed Aug 15, 2023
    Configuration menu
    Copy the full SHA
    ecf897c View commit details
    Browse the repository at this point in the history

  20. Merge branch 'dev' into feat/llm_in_ranking_based_selector

    @smilni
    smilni committed Aug 15, 2023
    Configuration menu
    Copy the full SHA
    165989a View commit details
    Browse the repository at this point in the history

  21. added to components.tsv

    @smilni
    smilni committed Aug 15, 2023
    Configuration menu
    Copy the full SHA
    4bab168 View commit details
    Browse the repository at this point in the history

Commits on Aug 24, 2023

  1. ranking-based-response-selector-fact-checking correct name everywhere

    @smilni
    smilni committed Aug 24, 2023
    Configuration menu
    Copy the full SHA
    04466ef View commit details
    Browse the repository at this point in the history

  2. added fact-checking to runtests

    @smilni
    smilni committed Aug 24, 2023
    Configuration menu
    Copy the full SHA
    be6113d View commit details
    Browse the repository at this point in the history

  3. fix ranking based response selector path

    @smilni
    smilni committed Aug 24, 2023
    Configuration menu
    Copy the full SHA
    f1fcfe4 View commit details
    Browse the repository at this point in the history

Commits on Sep 5, 2023

  1. Merge branch 'dev' into feat/llm_in_ranking_based_selector

    @smilni
    smilni committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    0d552ad View commit details
    Browse the repository at this point in the history

  2. ranking-based-response-selector-fact-checking in tests

    @smilni
    smilni committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    968f979 View commit details
    Browse the repository at this point in the history

Commits on Sep 26, 2023

  1. typo fix

    @smilni
    smilni committed Sep 26, 2023
    Configuration menu
    Copy the full SHA
    88e2660 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'dev' into feat/llm_in_ranking_based_selector

    @smilni
    smilni committed Sep 26, 2023
    Configuration menu
    Copy the full SHA
    76b20da View commit details
    Browse the repository at this point in the history

  3. minor fixes, mainly container name

    @smilni
    smilni committed Sep 26, 2023
    Configuration menu
    Copy the full SHA
    695dcbe View commit details
    Browse the repository at this point in the history

Commits on Sep 27, 2023

  1. add SERVICE_PORT and SERVICE_NAME everywhere

    @smilni
    smilni committed Sep 27, 2023
    Configuration menu
    Copy the full SHA
    7a4f978 View commit details
    Browse the repository at this point in the history

  2. small change in test for more visible effect

    @smilni
    smilni committed Sep 27, 2023
    Configuration menu
    Copy the full SHA
    8ccd3e0 View commit details
    Browse the repository at this point in the history