The RADICAL pilot job framework
Project description
#radical.pilot
Documentation: http://radicalpilot.readthedocs.org/en/latest/
Mailinglist: radical-pilot-devel@googlegroups.com
* For a list of bug fixes, see
https://github.com/radical-cybertools/radical.pilot/issues?q=is%3Aissue+is%3Aclosed+sort%3Aupdated-desc
* For a list of open issues and known problems, see
https://github.com/radical-cybertools/radical.pilot/issues?q=is%3Aissue+is%3Aopen+
0.24 Release 2015-03-30
---------------------------------------------------------------------
* More support for URLs in StagingDirectives (#489).
* Create parent directories of staged files.
* Only process entries for Output FTW, fixes #490.
* SuperMUC config change.
* switch from bson to json for session dumps
* fixes #451
* update resources.rst
* remove superfluous \n
* fix #438
* add documentation on resource config changes, closes #421
* .ssh/authorized_keys2 is deprecated since 2011
* improved intra-node SSH FAQ item
0.23 Release 2014-12-13
---------------------------------------------------------------------
* fix #455
0.22 Release 2014-12-11
---------------------------------------------------------------------
* several state races fixed
* fix to tools for session cleanup and purging
* partial fix for pilot cancelation
* improved shutdown behavior
* improved hopper support
* adapt plotting to changed slothistory format
* make instructions clearer on data staging examples
* addresses issue #216
* be more resilient on pilot shutdown
* take care of cancelling of active pilots
* fix logic error on state check for pilot cancellation
* fix blacklight config (#360)
* attempt to cancel pilots timely...
* as fallback, use PPN information provided by SAGA
* hopper usues torque (thanks Mark!)
* Re-fix blacklight config. Addresses #359 (again).
* allow to pass application data to callbacks
* threads should not be daemons...
* workaround on failing bson encoding...
* report pilot id on cu inspection
* ignore caching errors
* also use staging flags on input staging
* stampede environment fix
* Added missing stampede alias
* adds timestamps to unit and pilot logentries
* fix state tags for plots
* fix plot style for waitq
* introduce UNSCHEDULED state as per #233
* selectable terminal type for plot
* document pilot log env
* add faq about VE problems on setuptools upgrade
* allow to specify session cache files
* added configuration for BlueBiou (Thanks Jordane)
* better support for json/bson/timestamp handling; cache mongodb data for stats, plots etc
* localize numpy dependency
* retire input_data and output_data
* remove obsolete staging examples
* address #410
* fix another subtle state race
0.21 Release 2014-10-29
---------------------------------------------------------------------
* Documentation of MPI support
* Documentation of data staging operations
* correct handling of data transfer exceptions
* fix handling of non-ascii data in unit stdio
* simplify switching of access schemas on pilot submission
* disable pilot virtualenv for unit execution
* MPI support for DaVinci
* performance optimizations on file transfers, unit sandbox setup
* fix ibrun tmp file problem on stampede
0.19 Release September 12. 2014
---------------------------------------------------------------------
* The Milestone 8 release (MS.8)
* Closed Tickets:
- https://github.com/radical-cybertools/radical.pilot/issues?q=is%3Aclosed+milestone%3AMS-8+
0.18 Release July 22. 2014
---------------------------------------------------------------------
* The Milestone 7 release (MS.7)
* Closed Tickets:
- https://github.com/radical-cybertools/radical.pilot/issues?milestone=13&state=closed
0.17 Release June 18. 2014
---------------------------------------------------------------------
Bugfix release - fixed file permissions et al. :/
0.16 Release June 17. 2014
---------------------------------------------------------------------
Bugfix release - fixed file permissions et al.
0.15 Release June 12. 2014
---------------------------------------------------------------------
Bugfix release - fixed distribution MANIFEST:
https://github.com/radical-cybertools/radical.pilot/issues/174
0.14 Release June 11. 2014
---------------------------------------------------------------------
Closed Tickets:
* https://github.com/radical-cybertools/radical.pilot/issues?milestone=16&state=closed
New Features
* Experimental pilot-agent for Cray systems
* New multi-core agent with MPI support
* New ResourceConfig mechanism does not reuquire the user to add
resource configurations explicitly. Resources can be configured
programatically on API-level.
API Changes:
* ComputeUnitDescription.working_dir_priv removed
* Extended state model
* resource_configurations parameter removed from PilotManager c`tor
0.13 Release May 19. 2014
---------------------------------------------------------------------
* ExTASY demo release
* Support for project / allocation
* Updated / simplified resource files
* Refactored bootstrap mechnism
0.12 Release May 09. 2014
---------------------------------------------------------------------
* Updated resource files
* Updated state model
* Closed tickets:
- https://github.com/radical-cybertools/radical.pilot/issues?milestone=12&state=closed
0.11 Release Apr. 29. 2014
---------------------------------------------------------------------
* Fixes error in state history reporting
0.10 Release Apr. 29. 2014
---------------------------------------------------------------------
* Support for state transition introspection via CU/Pilot state_history
* Cleaned up an streamlined Input and Outpout file transfer workers
* Support for interchangeable pilot agents
* Closed tickets:
- https://github.com/radical-cybertools/radical.pilot/issues?milestone=11&state=closed
0.9 Release Apr. 16. 2014
---------------------------------------------------------------------
* Support for output file staging
* Streamlines data model
* More loosely coupled components connected via DB queues
* Closed tickets:
- https://github.com/radical-cybertools/radical.pilot/issues?milestone=10&state=closed
0.8 Release Mar. 24. 2014
---------------------------------------------------------------------
* Renamed codebase from sagapilot to radical.pilot
* Added explicit close() calls to PM, UM and Session.
* Cloesed tickets:
- https://github.com/radical-cybertools/radical.pilot/issues?milestone=9&state=closed
0.7 Release Feb. 25. 2014
---------------------------------------------------------------------
* Added support for callbacks
* Added support for input file transfer !
* Closed tickets:
- https://github.com/radical-cybertools/radical.pilot/issues?milestone=8&state=closed
0.6 Release Feb. 24. 2014
---------------------------------------------------------------------
* BROKEN RELEASE
0.5 Release Feb. 06. 2014
---------------------------------------------------------------------
* Tutorial 2 release (Github only)
* Added support for multiprocessing worker
* Support for CU stdout and stderr transfer via MongoDB GridFS
* Closed tickets:
- https://github.com/saga-project/saga-pilot/issues?milestone=7&page=1&state=closed
0.4 Release
---------------------------------------------------------------------
* Tutorial 1 release (Github only)
* Consistent naming (sagapilot instead of sinon)
0.1.3 Release
---------------------------------------------------------------------
* Github only release:
pip install --upgrade -e git://github.com/saga-project/saga-pilot.git@master#egg=saga-pilot
* Added logging
* Added security context handling
* Closed tickets:
- https://github.com/saga-project/saga-pilot/issues?milestone=3&state=closed
0.1.2 Release
---------------------------------------------------------------------
* Github only release:
pip install --upgrade -e git://github.com/saga-project/saga-pilot.git@master#egg=saga-pilot
* Closed tickets:
- https://github.com/saga-project/saga-pilot/issues?milestone=4&state=closed
Documentation: http://radicalpilot.readthedocs.org/en/latest/
Mailinglist: radical-pilot-devel@googlegroups.com
* For a list of bug fixes, see
https://github.com/radical-cybertools/radical.pilot/issues?q=is%3Aissue+is%3Aclosed+sort%3Aupdated-desc
* For a list of open issues and known problems, see
https://github.com/radical-cybertools/radical.pilot/issues?q=is%3Aissue+is%3Aopen+
0.24 Release 2015-03-30
---------------------------------------------------------------------
* More support for URLs in StagingDirectives (#489).
* Create parent directories of staged files.
* Only process entries for Output FTW, fixes #490.
* SuperMUC config change.
* switch from bson to json for session dumps
* fixes #451
* update resources.rst
* remove superfluous \n
* fix #438
* add documentation on resource config changes, closes #421
* .ssh/authorized_keys2 is deprecated since 2011
* improved intra-node SSH FAQ item
0.23 Release 2014-12-13
---------------------------------------------------------------------
* fix #455
0.22 Release 2014-12-11
---------------------------------------------------------------------
* several state races fixed
* fix to tools for session cleanup and purging
* partial fix for pilot cancelation
* improved shutdown behavior
* improved hopper support
* adapt plotting to changed slothistory format
* make instructions clearer on data staging examples
* addresses issue #216
* be more resilient on pilot shutdown
* take care of cancelling of active pilots
* fix logic error on state check for pilot cancellation
* fix blacklight config (#360)
* attempt to cancel pilots timely...
* as fallback, use PPN information provided by SAGA
* hopper usues torque (thanks Mark!)
* Re-fix blacklight config. Addresses #359 (again).
* allow to pass application data to callbacks
* threads should not be daemons...
* workaround on failing bson encoding...
* report pilot id on cu inspection
* ignore caching errors
* also use staging flags on input staging
* stampede environment fix
* Added missing stampede alias
* adds timestamps to unit and pilot logentries
* fix state tags for plots
* fix plot style for waitq
* introduce UNSCHEDULED state as per #233
* selectable terminal type for plot
* document pilot log env
* add faq about VE problems on setuptools upgrade
* allow to specify session cache files
* added configuration for BlueBiou (Thanks Jordane)
* better support for json/bson/timestamp handling; cache mongodb data for stats, plots etc
* localize numpy dependency
* retire input_data and output_data
* remove obsolete staging examples
* address #410
* fix another subtle state race
0.21 Release 2014-10-29
---------------------------------------------------------------------
* Documentation of MPI support
* Documentation of data staging operations
* correct handling of data transfer exceptions
* fix handling of non-ascii data in unit stdio
* simplify switching of access schemas on pilot submission
* disable pilot virtualenv for unit execution
* MPI support for DaVinci
* performance optimizations on file transfers, unit sandbox setup
* fix ibrun tmp file problem on stampede
0.19 Release September 12. 2014
---------------------------------------------------------------------
* The Milestone 8 release (MS.8)
* Closed Tickets:
- https://github.com/radical-cybertools/radical.pilot/issues?q=is%3Aclosed+milestone%3AMS-8+
0.18 Release July 22. 2014
---------------------------------------------------------------------
* The Milestone 7 release (MS.7)
* Closed Tickets:
- https://github.com/radical-cybertools/radical.pilot/issues?milestone=13&state=closed
0.17 Release June 18. 2014
---------------------------------------------------------------------
Bugfix release - fixed file permissions et al. :/
0.16 Release June 17. 2014
---------------------------------------------------------------------
Bugfix release - fixed file permissions et al.
0.15 Release June 12. 2014
---------------------------------------------------------------------
Bugfix release - fixed distribution MANIFEST:
https://github.com/radical-cybertools/radical.pilot/issues/174
0.14 Release June 11. 2014
---------------------------------------------------------------------
Closed Tickets:
* https://github.com/radical-cybertools/radical.pilot/issues?milestone=16&state=closed
New Features
* Experimental pilot-agent for Cray systems
* New multi-core agent with MPI support
* New ResourceConfig mechanism does not reuquire the user to add
resource configurations explicitly. Resources can be configured
programatically on API-level.
API Changes:
* ComputeUnitDescription.working_dir_priv removed
* Extended state model
* resource_configurations parameter removed from PilotManager c`tor
0.13 Release May 19. 2014
---------------------------------------------------------------------
* ExTASY demo release
* Support for project / allocation
* Updated / simplified resource files
* Refactored bootstrap mechnism
0.12 Release May 09. 2014
---------------------------------------------------------------------
* Updated resource files
* Updated state model
* Closed tickets:
- https://github.com/radical-cybertools/radical.pilot/issues?milestone=12&state=closed
0.11 Release Apr. 29. 2014
---------------------------------------------------------------------
* Fixes error in state history reporting
0.10 Release Apr. 29. 2014
---------------------------------------------------------------------
* Support for state transition introspection via CU/Pilot state_history
* Cleaned up an streamlined Input and Outpout file transfer workers
* Support for interchangeable pilot agents
* Closed tickets:
- https://github.com/radical-cybertools/radical.pilot/issues?milestone=11&state=closed
0.9 Release Apr. 16. 2014
---------------------------------------------------------------------
* Support for output file staging
* Streamlines data model
* More loosely coupled components connected via DB queues
* Closed tickets:
- https://github.com/radical-cybertools/radical.pilot/issues?milestone=10&state=closed
0.8 Release Mar. 24. 2014
---------------------------------------------------------------------
* Renamed codebase from sagapilot to radical.pilot
* Added explicit close() calls to PM, UM and Session.
* Cloesed tickets:
- https://github.com/radical-cybertools/radical.pilot/issues?milestone=9&state=closed
0.7 Release Feb. 25. 2014
---------------------------------------------------------------------
* Added support for callbacks
* Added support for input file transfer !
* Closed tickets:
- https://github.com/radical-cybertools/radical.pilot/issues?milestone=8&state=closed
0.6 Release Feb. 24. 2014
---------------------------------------------------------------------
* BROKEN RELEASE
0.5 Release Feb. 06. 2014
---------------------------------------------------------------------
* Tutorial 2 release (Github only)
* Added support for multiprocessing worker
* Support for CU stdout and stderr transfer via MongoDB GridFS
* Closed tickets:
- https://github.com/saga-project/saga-pilot/issues?milestone=7&page=1&state=closed
0.4 Release
---------------------------------------------------------------------
* Tutorial 1 release (Github only)
* Consistent naming (sagapilot instead of sinon)
0.1.3 Release
---------------------------------------------------------------------
* Github only release:
pip install --upgrade -e git://github.com/saga-project/saga-pilot.git@master#egg=saga-pilot
* Added logging
* Added security context handling
* Closed tickets:
- https://github.com/saga-project/saga-pilot/issues?milestone=3&state=closed
0.1.2 Release
---------------------------------------------------------------------
* Github only release:
pip install --upgrade -e git://github.com/saga-project/saga-pilot.git@master#egg=saga-pilot
* Closed tickets:
- https://github.com/saga-project/saga-pilot/issues?milestone=4&state=closed
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
radical.pilot-0.24.tar.gz
(266.0 kB
view details)
File details
Details for the file radical.pilot-0.24.tar.gz.
File metadata
- Download URL: radical.pilot-0.24.tar.gz
- Upload date:
- Size: 266.0 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 16b4b9a0ed87e02d5e8073795bf863b205f3330ae2ce99c397d9125ddb6a234e |
|
| MD5 | 6f6e5b59ac17e620dbcf361cb574effd |
|
| BLAKE2b-256 | 0e060abd8d5d368250e3a885cc3fe4b43a3dcbf6ce7eb75db56dbd3f66375503 |
