Submit Functional Queries to a ServiceX endpoint.
Project description
func_adl_servicex
Send func_adl expressions to a ServiceX endpoint
Introduction
This package contains the single object ServiceXSourceXAOD and ``ServiceXSourceUpROOTwhich can be used as a root of afunc_adl` expression to query large LHC datasets from an active `ServiceX` instance located on the net.
See below for simple examples.
Further Information
servicexdocumentationfunc_adldocumentation
Usage
To use func_adl on servicex, the only func_adl package you only need to install this package. All others required will be pulled in as dependencies of this package.
Using the xAOD backend
See the further information for documentation above to understand how this works. Here is a quick sample that will run against an ATLAS xAOD backend in servicex to get out jet pt's for those jets with pt > 30 GeV.
from func_adl_servicex import ServiceXSourceXAOD
dataset_xaod = "mc15_13TeV:mc15_13TeV.361106.PowhegPythia8EvtGen_AZNLOCTEQ6L1_Zee.merge.DAOD_STDM3.e3601_s2576_s2132_r6630_r6264_p2363_tid05630052_00"
ds = ServiceXSourceXAOD(dataset_xaod)
data = ds \
.SelectMany('lambda e: (e.Jets("AntiKt4EMTopoJets"))') \
.Where('lambda j: (j.pt()/1000)>30') \
.Select('lambda j: j.pt()') \
.AsAwkwardArray(["JetPt"]) \
.value()
print(data['JetPt'])
Using the CMS Run 1 AOD backend
See the further information for documentation above to understand how this works. Here is a quick sample that will run against an CMS Run 1 AOD backend in servicex. It turns against a 6 TB CMS Open Data dataset, selecting global muons with a pT greater than 30 GeV.
from func_adl_servicex import ServiceXSourceCMSRun1AOD
dataset_xaod = "cernopendata://16"
ds = ServiceXSourceCMSRun1AOD(dataset_xaod)
data = ds \
data = ServiceXSourceCMSRun1AOD("cernopendata://16") \
.SelectMany(lambda e: e.TrackMuons("globalMuons")) \
.Where(lambda m: m.pt() > 30) \
.Select(lambda m: m.pt()) \
.AsAwkwardArray(['mu_pt']) \
.value()
print(data['mu_pt'])
Using the uproot backend
See the further information for documentation above to understand how this works. Here is a quick sample that will run against a ROOT file (TTree) in the uproot backend in servicex to get out jet pt's. Note that the image name tag is likely wrong here. See XXX to get the current one.
from servicex import ServiceXDataset
from func_adl_servicex import ServiceXSourceUpROOT
dataset_uproot = "user.kchoi:user.kchoi.ttHML_80fb_ttbar"
uproot_transformer_image = "sslhep/servicex_func_adl_uproot_transformer:issue6"
sx_dataset = ServiceXDataset(dataset_uproot, image=uproot_transformer_image)
ds = ServiceXSourceUpROOT(sx_dataset, "nominal")
data = ds.Select("lambda e: {'lep_pt_1': e.lep_Pt_1, 'lep_pt_2': e.lep_Pt_2}") \
.AsParquetFiles('junk.parquet') \
.value()
print(data)
Development
PR's are welcome! Feel free to add an issue for new features or questions.
The master branch is the most recent commits that both pass all tests and are slated for the next release. Releases are tagged. Modifications to any released versions are made off those tags.
Qastle
This is for people working with the back-ends that run in servicex.
This is the qastle produced for an xAOD dataset:
(call EventDataset 'ServiceXDatasetSource')
(the actual dataset name is passed in the servicex web API call.)
This is the qastle produced for a ROOT flat file:
(call EventDataset 'ServiceXDatasetSource' 'tree_name')
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file func_adl_servicex-1.1b8.tar.gz.
File metadata
- Download URL: func_adl_servicex-1.1b8.tar.gz
- Upload date:
- Size: 5.6 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.4.2 importlib_metadata/4.6.3 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.0 CPython/3.8.11
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 56f94a979f92091212c8243e2e4bc1ecb54ca3a7e6ea93440cfadd94ec5785b2 |
|
| MD5 | 9f4d16049df8fd6683470b8aac1e3b35 |
|
| BLAKE2b-256 | 943f37c799bab0375a3e0ea592765bf25df30f85fd6d550fc935003a940f4b0e |
Provenance
File details
Details for the file func_adl_servicex-1.1b8-py3-none-any.whl.
File metadata
- Download URL: func_adl_servicex-1.1b8-py3-none-any.whl
- Upload date:
- Size: 5.8 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.4.2 importlib_metadata/4.6.3 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.0 CPython/3.8.11
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 8a856738071568bf5c4d38be6f4bb6fc9ffd3f438c8b7f5686c80dc0b7f3997b |
|
| MD5 | adf9945bdf0e3e3edf51db37597141b3 |
|
| BLAKE2b-256 | 40241e7a00e265e79872d13f70f697212f48feeac71562c79b51397c21d912cd |
