Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Re-running CosmoDC2 #359

Closed
wants to merge 64 commits into from
Closed

Re-running CosmoDC2 #359

wants to merge 64 commits into from

Conversation

joezuntz
Copy link
Collaborator

Changes to the pipeline since Prat et al have meant that we need to re-run an at-scale test.

@joezuntz
fix Neff calculation in calib for parallel systems
2f35072
@joezuntz
path and config updates for cosmodc2
a379da3
@joezuntz
generate quantiles in a new stage
d17b25a
@joezuntz
changes to make CosmoDC2 run work
9450e31
@joezuntz
trying to switch selector
4f84d77
@joezuntz
fix TXRandomForestLensSelector options
79e5311
@joezuntz
Merge master into branch
3380ec2
@joezuntz
update 20 deg^2 pipeline file
368aa20
@joezuntz
Merge branch 'master' into cosmodc2-rerun
d092e12
@joezuntz
update yaml files for cosmodc2
1865ff5
@joezuntz
image updates
a70b7f1
@joezuntz
Merge branch 'cosmodc2-rerun' of https://github.com/LSSTDESC/TXPipe i…
fa33ca6 
…nto cosmodc2-rerun
@joezuntz
run ceci update here too
aaf3059
@joezuntz
Merge master
5611869
@joezuntz
Update TXSourceTrueNumberDensity
28aceb3
@joezuntz
WIP
b70abfa
@joezuntz
Fix zero sized patches
3bfca09
@joezuntz
Merge branch 'cosmodc2-rerun' of https://github.com/LSSTDESC/TXPipe i…
ecc5593 
…nto cosmodc2-rerun
@joezuntz
Make min size 2
6a7d44c
@joezuntz
config and code fixes
cd16874
@joezuntz
add theory to plots
81703c4
@joezuntz
a few more tweaks
e45e4ea
@joezuntz
diagnostic quantile update
d0ad811
@joezuntz
make quantiles of every column
eac9a82
@joezuntz
add nersc installer
b1b9d21
@joezuntz
wtf
e69947c
@joezuntz
oh that
7b0fde8
@joezuntz
fix = ==
29eeae2
@joezuntz
new installer might even work
ac54843
@joezuntz
make installer executable
c12c2e1
@joezuntz
20deg2 update
9b3f5df
@joezuntz
more error handling in line fit
2ed6c8c
@joezuntz
work in progress
9a1719c
@joezuntz
go back to older diagnostics file
f3c3a93
@joezuntz
fix source-only
a92ea88
@joezuntz
fix lensfit
aa26c65
@joezuntz
fix dry runs
d43958b
@joezuntz
fix return from rank>0 metadetectcalculator
000e434
@joezuntz
Fix parallelization bug in plot_psf_shear
4174931
@joezuntz
restore options in 20 deg^2 config
f3aeb27
@joezuntz
print lens counts in selector
8455a01
@joezuntz
print out more progress
597e26b
@joezuntz
update cosmodc2 config files
fa2dfa2
@joezuntz
add option to smooth n(z) in theory
9c6bec8
@joezuntz
fix error message in theory_model
1a069da
@joezuntz
WIP covariance with MPI
cc5b97f
@joezuntz
Switch to MPI for basic covariance
4840214
@joezuntz
Switch to dask-based TXAuxiliarySourceMaps
517855a
@joezuntz
fix parallel type
05b465f
@joezuntz
Fix weight mistake in new aux mapper
ee1fab2
@joezuntz
Make it easier to debug dask in future using TX_DASK_DEBUG
03a5188
@joezuntz
replace lens mapper with much faster dask version
1a1da93
@joezuntz
save metadfata
6f6fdf3
@joezuntz
add dask_parallel flag
753feed
@joezuntz
force all dask block sizes to be the same even if dtypes are different
54745ae
@joezuntz
fix typo
c31879d
@joezuntz joezuntz marked this pull request as ready for review September 19, 2024 09:27
@joezuntz joezuntz closed this Sep 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@joezuntz