The RADICAL pilot job framework
Project description
#radical.pilot
Documentation: http://radicalpilot.readthedocs.org/en/latest/
Mailinglist: radical-pilot-devel@googlegroups.com
* For a list of bug fixes, see
https://github.com/radical-cybertools/radical.pilot/issues?q=is%3Aissue+is%3Aclosed+sort%3Aupdated-desc
* For a list of open issues and known problems, see
https://github.com/radical-cybertools/radical.pilot/issues?q=is%3Aissue+is%3Aopen+
0.22 Release 2014-12-11
---------------------------------------------------------------------
* several state races fixed
* fix to tools for session cleanup and purging
* partial fix for pilot cancelation
* improved shutdown behavior
* improved hopper support
* adapt plotting to changed slothistory format
* make instructions clearer on data staging examples
* addresses issue #216
* be more resilient on pilot shutdown
* take care of cancelling of active pilots
* fix logic error on state check for pilot cancellation
* fix blacklight config (#360)
* attempt to cancel pilots timely...
* as fallback, use PPN information provided by SAGA
* hopper usues torque (thanks Mark!)
* Re-fix blacklight config. Addresses #359 (again).
* allow to pass application data to callbacks
* threads should not be daemons...
* workaround on failing bson encoding...
* report pilot id on cu inspection
* ignore caching errors
* also use staging flags on input staging
* stampede environment fix
* Added missing stampede alias
* adds timestamps to unit and pilot logentries
* fix state tags for plots
* fix plot style for waitq
* introduce UNSCHEDULED state as per #233
* selectable terminal type for plot
* document pilot log env
* add faq about VE problems on setuptools upgrade
* allow to specify session cache files
* added configuration for BlueBiou (Thanks Jordane)
* better support for json/bson/timestamp handling; cache mongodb data for stats, plots etc
* localize numpy dependency
* retire input_data and output_data
* remove obsolete staging examples
* address #410
* fix another subtle state race
0.21 Release 2014-10-29
---------------------------------------------------------------------
* Documentation of MPI support
* Documentation of data staging operations
* correct handling of data transfer exceptions
* fix handling of non-ascii data in unit stdio
* simplify switching of access schemas on pilot submission
* disable pilot virtualenv for unit execution
* MPI support for DaVinci
* performance optimizations on file transfers, unit sandbox setup
* fix ibrun tmp file problem on stampede
0.19 Release September 12. 2014
---------------------------------------------------------------------
* The Milestone 8 release (MS.8)
* Closed Tickets:
- https://github.com/radical-cybertools/radical.pilot/issues?q=is%3Aclosed+milestone%3AMS-8+
0.18 Release July 22. 2014
---------------------------------------------------------------------
* The Milestone 7 release (MS.7)
* Closed Tickets:
- https://github.com/radical-cybertools/radical.pilot/issues?milestone=13&state=closed
0.17 Release June 18. 2014
---------------------------------------------------------------------
Bugfix release - fixed file permissions et al. :/
0.16 Release June 17. 2014
---------------------------------------------------------------------
Bugfix release - fixed file permissions et al.
0.15 Release June 12. 2014
---------------------------------------------------------------------
Bugfix release - fixed distribution MANIFEST:
https://github.com/radical-cybertools/radical.pilot/issues/174
0.14 Release June 11. 2014
---------------------------------------------------------------------
Closed Tickets:
* https://github.com/radical-cybertools/radical.pilot/issues?milestone=16&state=closed
New Features
* Experimental pilot-agent for Cray systems
* New multi-core agent with MPI support
* New ResourceConfig mechanism does not reuquire the user to add
resource configurations explicitly. Resources can be configured
programatically on API-level.
API Changes:
* ComputeUnitDescription.working_dir_priv removed
* Extended state model
* resource_configurations parameter removed from PilotManager c`tor
0.13 Release May 19. 2014
---------------------------------------------------------------------
* ExTASY demo release
* Support for project / allocation
* Updated / simplified resource files
* Refactored bootstrap mechnism
0.12 Release May 09. 2014
---------------------------------------------------------------------
* Updated resource files
* Updated state model
* Closed tickets:
- https://github.com/radical-cybertools/radical.pilot/issues?milestone=12&state=closed
0.11 Release Apr. 29. 2014
---------------------------------------------------------------------
* Fixes error in state history reporting
0.10 Release Apr. 29. 2014
---------------------------------------------------------------------
* Support for state transition introspection via CU/Pilot state_history
* Cleaned up an streamlined Input and Outpout file transfer workers
* Support for interchangeable pilot agents
* Closed tickets:
- https://github.com/radical-cybertools/radical.pilot/issues?milestone=11&state=closed
0.9 Release Apr. 16. 2014
---------------------------------------------------------------------
* Support for output file staging
* Streamlines data model
* More loosely coupled components connected via DB queues
* Closed tickets:
- https://github.com/radical-cybertools/radical.pilot/issues?milestone=10&state=closed
0.8 Release Mar. 24. 2014
---------------------------------------------------------------------
* Renamed codebase from sagapilot to radical.pilot
* Added explicit close() calls to PM, UM and Session.
* Cloesed tickets:
- https://github.com/radical-cybertools/radical.pilot/issues?milestone=9&state=closed
0.7 Release Feb. 25. 2014
---------------------------------------------------------------------
* Added support for callbacks
* Added support for input file transfer !
* Closed tickets:
- https://github.com/radical-cybertools/radical.pilot/issues?milestone=8&state=closed
0.6 Release Feb. 24. 2014
---------------------------------------------------------------------
* BROKEN RELEASE
0.5 Release Feb. 06. 2014
---------------------------------------------------------------------
* Tutorial 2 release (Github only)
* Added support for multiprocessing worker
* Support for CU stdout and stderr transfer via MongoDB GridFS
* Closed tickets:
- https://github.com/saga-project/saga-pilot/issues?milestone=7&page=1&state=closed
0.4 Release
---------------------------------------------------------------------
* Tutorial 1 release (Github only)
* Consistent naming (sagapilot instead of sinon)
0.1.3 Release
---------------------------------------------------------------------
* Github only release:
pip install --upgrade -e git://github.com/saga-project/saga-pilot.git@master#egg=saga-pilot
* Added logging
* Added security context handling
* Closed tickets:
- https://github.com/saga-project/saga-pilot/issues?milestone=3&state=closed
0.1.2 Release
---------------------------------------------------------------------
* Github only release:
pip install --upgrade -e git://github.com/saga-project/saga-pilot.git@master#egg=saga-pilot
* Closed tickets:
- https://github.com/saga-project/saga-pilot/issues?milestone=4&state=closed
Documentation: http://radicalpilot.readthedocs.org/en/latest/
Mailinglist: radical-pilot-devel@googlegroups.com
* For a list of bug fixes, see
https://github.com/radical-cybertools/radical.pilot/issues?q=is%3Aissue+is%3Aclosed+sort%3Aupdated-desc
* For a list of open issues and known problems, see
https://github.com/radical-cybertools/radical.pilot/issues?q=is%3Aissue+is%3Aopen+
0.22 Release 2014-12-11
---------------------------------------------------------------------
* several state races fixed
* fix to tools for session cleanup and purging
* partial fix for pilot cancelation
* improved shutdown behavior
* improved hopper support
* adapt plotting to changed slothistory format
* make instructions clearer on data staging examples
* addresses issue #216
* be more resilient on pilot shutdown
* take care of cancelling of active pilots
* fix logic error on state check for pilot cancellation
* fix blacklight config (#360)
* attempt to cancel pilots timely...
* as fallback, use PPN information provided by SAGA
* hopper usues torque (thanks Mark!)
* Re-fix blacklight config. Addresses #359 (again).
* allow to pass application data to callbacks
* threads should not be daemons...
* workaround on failing bson encoding...
* report pilot id on cu inspection
* ignore caching errors
* also use staging flags on input staging
* stampede environment fix
* Added missing stampede alias
* adds timestamps to unit and pilot logentries
* fix state tags for plots
* fix plot style for waitq
* introduce UNSCHEDULED state as per #233
* selectable terminal type for plot
* document pilot log env
* add faq about VE problems on setuptools upgrade
* allow to specify session cache files
* added configuration for BlueBiou (Thanks Jordane)
* better support for json/bson/timestamp handling; cache mongodb data for stats, plots etc
* localize numpy dependency
* retire input_data and output_data
* remove obsolete staging examples
* address #410
* fix another subtle state race
0.21 Release 2014-10-29
---------------------------------------------------------------------
* Documentation of MPI support
* Documentation of data staging operations
* correct handling of data transfer exceptions
* fix handling of non-ascii data in unit stdio
* simplify switching of access schemas on pilot submission
* disable pilot virtualenv for unit execution
* MPI support for DaVinci
* performance optimizations on file transfers, unit sandbox setup
* fix ibrun tmp file problem on stampede
0.19 Release September 12. 2014
---------------------------------------------------------------------
* The Milestone 8 release (MS.8)
* Closed Tickets:
- https://github.com/radical-cybertools/radical.pilot/issues?q=is%3Aclosed+milestone%3AMS-8+
0.18 Release July 22. 2014
---------------------------------------------------------------------
* The Milestone 7 release (MS.7)
* Closed Tickets:
- https://github.com/radical-cybertools/radical.pilot/issues?milestone=13&state=closed
0.17 Release June 18. 2014
---------------------------------------------------------------------
Bugfix release - fixed file permissions et al. :/
0.16 Release June 17. 2014
---------------------------------------------------------------------
Bugfix release - fixed file permissions et al.
0.15 Release June 12. 2014
---------------------------------------------------------------------
Bugfix release - fixed distribution MANIFEST:
https://github.com/radical-cybertools/radical.pilot/issues/174
0.14 Release June 11. 2014
---------------------------------------------------------------------
Closed Tickets:
* https://github.com/radical-cybertools/radical.pilot/issues?milestone=16&state=closed
New Features
* Experimental pilot-agent for Cray systems
* New multi-core agent with MPI support
* New ResourceConfig mechanism does not reuquire the user to add
resource configurations explicitly. Resources can be configured
programatically on API-level.
API Changes:
* ComputeUnitDescription.working_dir_priv removed
* Extended state model
* resource_configurations parameter removed from PilotManager c`tor
0.13 Release May 19. 2014
---------------------------------------------------------------------
* ExTASY demo release
* Support for project / allocation
* Updated / simplified resource files
* Refactored bootstrap mechnism
0.12 Release May 09. 2014
---------------------------------------------------------------------
* Updated resource files
* Updated state model
* Closed tickets:
- https://github.com/radical-cybertools/radical.pilot/issues?milestone=12&state=closed
0.11 Release Apr. 29. 2014
---------------------------------------------------------------------
* Fixes error in state history reporting
0.10 Release Apr. 29. 2014
---------------------------------------------------------------------
* Support for state transition introspection via CU/Pilot state_history
* Cleaned up an streamlined Input and Outpout file transfer workers
* Support for interchangeable pilot agents
* Closed tickets:
- https://github.com/radical-cybertools/radical.pilot/issues?milestone=11&state=closed
0.9 Release Apr. 16. 2014
---------------------------------------------------------------------
* Support for output file staging
* Streamlines data model
* More loosely coupled components connected via DB queues
* Closed tickets:
- https://github.com/radical-cybertools/radical.pilot/issues?milestone=10&state=closed
0.8 Release Mar. 24. 2014
---------------------------------------------------------------------
* Renamed codebase from sagapilot to radical.pilot
* Added explicit close() calls to PM, UM and Session.
* Cloesed tickets:
- https://github.com/radical-cybertools/radical.pilot/issues?milestone=9&state=closed
0.7 Release Feb. 25. 2014
---------------------------------------------------------------------
* Added support for callbacks
* Added support for input file transfer !
* Closed tickets:
- https://github.com/radical-cybertools/radical.pilot/issues?milestone=8&state=closed
0.6 Release Feb. 24. 2014
---------------------------------------------------------------------
* BROKEN RELEASE
0.5 Release Feb. 06. 2014
---------------------------------------------------------------------
* Tutorial 2 release (Github only)
* Added support for multiprocessing worker
* Support for CU stdout and stderr transfer via MongoDB GridFS
* Closed tickets:
- https://github.com/saga-project/saga-pilot/issues?milestone=7&page=1&state=closed
0.4 Release
---------------------------------------------------------------------
* Tutorial 1 release (Github only)
* Consistent naming (sagapilot instead of sinon)
0.1.3 Release
---------------------------------------------------------------------
* Github only release:
pip install --upgrade -e git://github.com/saga-project/saga-pilot.git@master#egg=saga-pilot
* Added logging
* Added security context handling
* Closed tickets:
- https://github.com/saga-project/saga-pilot/issues?milestone=3&state=closed
0.1.2 Release
---------------------------------------------------------------------
* Github only release:
pip install --upgrade -e git://github.com/saga-project/saga-pilot.git@master#egg=saga-pilot
* Closed tickets:
- https://github.com/saga-project/saga-pilot/issues?milestone=4&state=closed
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
radical.pilot-0.22.tar.gz
(117.6 kB
view details)
File details
Details for the file radical.pilot-0.22.tar.gz.
File metadata
- Download URL: radical.pilot-0.22.tar.gz
- Upload date:
- Size: 117.6 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | cc4fa6e44921205884c94d78f83f1a273bf366d26d1aba9a565d8db6bd59aac0 |
|
| MD5 | 0b69be3d26fa8c5548fec5760a9d7f93 |
|
| BLAKE2b-256 | 499b5dff5776ef9a5142811d899c42d316878c20e5e8b84d3f2d316880a82dd3 |
