howto_new_release 1.3 KB

123456789101112131415161718192021222324252627282930313233343536
  1. on Azure:
  2. sudo apt install git tmux make python3-venv datalad
  3. tmux
  4. git clone https://github.com/mikapfl/unfccc_di_data
  5. cd unfccc_di_data
  6. rm -rf venv
  7. make venv
  8. source venv/bin/activate.fish (in case you use bash without the '.fish')
  9. datalad update -s ginhemio --how merge
  10. datalad rerun …
  11. datalad siblings add -s ginhemio --url https://gin.hemio.de/CR/unfcc_di_data --pushurl git@gin.hemio.de/CR/unfcc_di_data
  12. git config remote.ginhemio.annex-ignore false
  13. datalad push --to ginhemio --data anything
  14. At home:
  15. datalad update -s ginhemio --how update
  16. datalad update
  17. git pull
  18. if you want to compare differences, get the old and new CSVs, then run (in fish):
  19. for i in old/*.csv; echo $i; csvdiff --ignore-columns 0 -p 1,2,3,4,5,7 -o word-diff $i new/$(basename $i) > diff_$(basename $i); end
  20. you need https://github.com/aswinkarthik/csvdiff for that.
  21. if you are happy, start making new version on zenodo, get pre-reserved doi
  22. put new doi, new info into datacite.yml and README.md
  23. datalad save
  24. datalad push
  25. datalad push --to origin
  26. datalad push --to ginhemio --data anything
  27. datalad export-archive -t zip 'data-2022-10-12.zip'
  28. zip parquet-only.zip data/annexI/*.parquet data/non-annexI/*.parquet
  29. upload new data (including parquet-only.zip) to zenodo, publish
  30. new version of unfccc_di_api