Released versions

1.4.1 (2022-04-06)

Changed

easyget: adaptation to the new connection mode via sftp at ESRF, now with personal SMIS login
easyget: the password is now given in a hidden way

1.4.0 (2022-03-31)

Changed

easyget: now test next day for the date (for 24h collections) for each date given and not only when just one date
easypipe reindex command: doesn't run again if already done
easypipe reindex command: list at the end all the reindexations that failed
easypipe reindex command: copy xtriage log file of reindexed mtz along with reindexed mtz in data folder
easypipe launch command: addition of space group and template in the name of the log file

Fixed

easypipe reindex command: it happened xtriage failed on mtz after reindexing (on unusually incomplete data for example) and creates no log file where space group can be search. Now check if xtriage log file exists before searching space group.
easypipe reindex command: doesn't fail if error when writing mtz
easypipe reindex command: resolution and unit cell no more copied from csv from prep step, but searched in xtriage log as completeness and space group (for case xtriage failed at prep step but not at reindex step)
easypipe prep command: no more failure when problem with xtriage (error or no log file created)
easypipe launch command: if no resolution or completeness found at 'prep' step (failure with xtriage), no error and mtz marked as not to treat in launch csv file
easypipe launch command: sort by decreasing completeness was done on a string field, now sorted on floats so that 100% is no more at the end but first
easypipe summary command: no more failure when no RESULTS csv file in one of the RESULTS directories

1.3.0 (2021-12-01)

Added

easypipe launch command: new column 'ligand smiles' in RESULTS csv file, if 'ligand search' = yes write the smiles of the corresponding ligand if given at 'ligand' step (not the case if cif given)

Changed

easypipe prep command: copied XDS_ACSII.HKL but not XDS_ANOM.HKL, now copy all .HKL files
easypipe prep command: now also copy mtz files with 'multirecord' in their name (unmerged data for deposition)
easypipe: possible to run 'launch --best' instead of 'launch --best 1'

Fixed

easypipe launch command: copy of csv with mtz to be treated (launch csv) in RESULTS folder was done after running all Phenix. So if you wanted to launch again just modifying the launch csv file, before it ended, the csv with mtz to be treated copied at the end was no more the good one. Now, launch csv file is copied just before running all Phenix.

1.2.0 (2021-09-30)

Added

easypipe launch command: added option to treat the whole mtz processes
easypipe: added option to treat automatically all datasets, without ligand search. Run prep, reindex, launch and summary subcommands successively without any intervention

Changed

easypipe launch command: when no ligand search, no more error when R/Rfree is too high (and so results are copied in the result csv file)
easypipe launch command: in 'Phenix first round after Coot' column of csv result file (for linux), name of resulting pdb after first round has changed with the addition of the mode (full or fast)
easypipe reindex command: don't reindex when already done, just do it on new added datasets

Fixed

easyget: when only one date and given not in the command line, there was an error
easypipe launch command: didn't find anymore the space group in the reference pdb file, now OK
easypipe prep command: name of copied processed data folder deduced from path was wrong when dataset name appeared in a subfolder name
easypipe launch command: column 'failing step' in RESULTS csv file, after 'SUCESS' column. If SUCCESS = "no", get the last title in pipeline.log file, sometimes it wasn't the title, now test if 80 characters ensuring it is a title

1.1.0 (2021-07-28)

Added

easyget: summary at the end of copied datasets, of datasets not copied because folder already exists, and of not copied datasets because no process
easyget: when just one date given, test also the day after (useful for 24h experiments ...)
easypipe / ligand command: at the end, list of datasets for which generation of cif has failed, list of datasets with well generated cif, list of datasets with already a cif in their 'ligand' folder, list of datasets without information for cif generation

Changed

easyget: now when several dates, they are listed without quotes in the command line
easyget: less verbose during datasets copy (not each file name written, only process folder)
easyget: when one date is not correct in a list of dates, doesn't stop and work with the right date(s)
easyget: when program stopped by user without download, this is now written in log
easypipe / reindex command: now csv with reindexed results is in '1b_reindex_`SG`' folder
easypipe / reindex command: when mtz sucessfully reindexed, no more rename previous mtz in .old, avoiding error when running again reindex command
easypipe / reindex command: use of phenix.reflection_file_converter instead of pointless to reindex, avoiding "Environment variable CLIBD not set ... big trouble!" when run with space group in some cases with Pointless
easypipe / reindex command: now reference space group is given directly without the need for a reference mtz
easypipe launch command: change in name of pdb copied from LigandFit to be homogeneous with corresponding pdb and mtz (order of information'CC', 'nb ligands' and 'mode')
easypipe / launch command: when copy of csv file with information to launch in RESULTS folder, _mtz_treated subfolder, the launch csv file is renamed with a counter in case of a new launch with this file but with some parameters changed in the file. Same counter for RESULTS_... csv files for the same reasons in RESULTS folder. Avoid overwriting previous files which leads to a loose of information on previous runs
easypipe / launch command: New column 'failing step' in RESULTS csv file, after 'SUCESS' column. If SUCCESS = "no", get the last title in pipeline.log file so as we can know at which step it failed

Fixed

easypipe: in the command line in 'Phenix first round after Coot' column, the name of files was not good because information 'CC' and 'nb ligands' had been included in the name of files to avoid overwriting results files
easypipe / reindex command: doesn't change anymore the name of reindexed file if resulting space group is not the one expected (so, if reindex is launched again, no file with _reindexed_sg_reindexed_sg.mtz in their name and no other bug like listed files not found)
easypipe / reindex command: problem with Pointless when spacegroup as input solved, but Pointless replaced by phenix.reflection_file_converter after this correction
easypipe / launch command: when completeness < completeness min or resolution > resolution min, process is launched in fast mode, but it should also not search for ligand. Now it is effectively the case

1.0.0 (2021-05-04)

First public release