Most stingray` classes are subclasses of a single class, stingray.StingrayObject, which
implements most of the I/O functionality and common behavior (e.g. strategies to combine data and
make operations such as the sum, difference, or negation). This class is not intended to be
instantiated directly, but rather to be used as a base class for other classes. Any class wanting
to inherit from stingray.StingrayObject should define a main_array_attr attribute, which
defines the name of the attribute that will be used to store the “independent variable” main data array.
For example, for all time series-like objects, the main array is the time array, while for the
periodograms the main array is the frequency array.
All arrays sharing the length (not the shape: they might be multi-dimensional!) of the main array are called
“array attributes” and are accessible through the array_attrs method.
When applying a mask or any other selection to a stingray.StingrayObject,
all array attributes are filtered in the same way. Some array-like attributes might have the same length
by chance, in this case the user or the developer should add these to the not_array_attr attribute.
For example, stingray.StingrayTimeseries has gti among the not_array_attrs, since it is an
array but not related 1-to-1 to the main array, even if in some cases it might happen to have the same numbers
of elements of the main array, which is time.
This base class defines some general-purpose utilities.
The main purpose is to have a consistent mechanism for:
round-tripping to and from Astropy Tables and other dataframes
round-tripping to files in different formats
The idea is that any object inheriting StingrayObject should,
just by defining an attribute called main_array_attr, be able to perform
the operations above, with no additional effort.
main_array_attr is, e.g. time for StingrayTimeseries and
Lightcurve, freq for Crossspectrum, energy for
VarEnergySpectrum, and so on. It is the array with which all other
attributes are compared: if they are of the same shape, they get saved as
columns of the table/dataframe, otherwise as metadata.
Array attributes to be operated on. Defaults to all array attributes not ending in
_err.
The other array attributes will be discarded from the time series to avoid
inconsistencies.
error_attrslist of str or None
Array attributes to be operated on with error_operation. Defaults to all array
attributes ending with _err.
error_operationfunction
Function to be called to propagate the errors
inplacebool
If True, overwrite the current time series. Otherwise, return a new one.
Apply a mask to all array attributes of the object
Parameters:
maskarray of bool
The mask. Has to be of the same length as self.time
Returns:
ts_newStingrayObject object
The new object with the mask applied if inplace is False, otherwise the
same object.
Other Parameters:
inplacebool
If True, overwrite the current object. Otherwise, return a new one.
filtered_attrslist of str or None
Array attributes to be filtered. Defaults to all array attributes if None.
The other array attributes will be set to None. The main array attr is always
included.
Clean up the list of attributes, only giving out those pointing to data.
List all the attributes that point directly to valid data. This method goes through all the
attributes of the class, eliminating methods, properties, and attributes that are complicated
to serialize such as other StingrayObject, or arrays of objects.
This function does not make difference between array-like data and scalar data.
Returns:
data_attributeslist of str
List of attributes pointing to data that are not methods, properties,
or other StingrayObject instances.
Create a Stingray Object object from data in an Astropy Table.
The table MUST contain at least a column named like the
main_array_attr.
The rest of columns will form the array attributes of the
new object, while the attributes in ds.attrs will
form the new meta attributes of the object.
Create an StingrayObject object from data in a pandas DataFrame.
The dataframe MUST contain at least a column named like the
main_array_attr.
The rest of columns will form the array attributes of the
new object, while the attributes in ds.attrs will
form the new meta attributes of the object.
Since pandas does not support n-D data, multi-dimensional arrays can be
specified as <colname>_dimN_M_K etc.
See documentation of make_1d_arrays_into_nd for details.
The dataset MUST contain at least a column named like the
main_array_attr.
The rest of columns will form the array attributes of the
new object, while the attributes in ds.attrs will
form the new meta attributes of the object.
List the names of the internal array attributes of the Stingray Object.
These are array attributes that can be set by properties, and are generally indicated
by an underscore followed by the name of the property that links to it (E.g.
_counts in Lightcurve).
By array attributes, we mean the ones with the same size and shape as
main_array_attr (e.g. time in EventList)
Return a pretty-printed string representation of the object.
This is useful for debugging, and for interactive use.
Other Parameters:
func_to_applyfunction
A function that modifies the attributes listed in attrs_to_apply.
It must return the modified attributes and a label to be printed.
If None, no function is applied.
any other formats compatible with the writers in
astropy.table.Table (ascii.ecsv, hdf5, etc.)
Files that need the astropy.table.Table interface MUST contain
at least a column named like the main_array_attr.
The default ascii format is enhanced CSV (ECSV). Data formats
supporting the serialization of metadata (such as ECSV and HDF5) can
contain all attributes such as mission, gti, etc with
no significant loss of information. Other file formats might lose part
of the metadata, so must be used with care.
..note:
Complex values can be dealt with out-of-the-box in some formats
like HDF5 or FITS, not in others (e.g. all ASCII formats).
With these formats, and in any case when fmt is ``None``, complex
values should be stored as two columns of real numbers, whose names
are of the format <variablename>.real and <variablename>.imag
Parameters:
filename: str
Path and file name for the file to be read.
fmt: str
Available options are ‘pickle’, ‘hea’, and any Table-supported
format such as ‘hdf5’, ‘ascii.ecsv’, etc.
Array attributes to be operated on. Defaults to all array attributes not ending in
_err.
The other array attributes will be discarded from the time series to avoid
inconsistencies.
error_attrslist of str or None
Array attributes to be operated on with error_operation. Defaults to all array
attributes ending with _err.
error_operationfunction
Function to be called to propagate the errors
inplacebool
If True, overwrite the current time series. Otherwise, return a new one.
Array attributes (e.g. time, pi, energy, etc. for
EventList) are converted into columns, while meta attributes
(mjdref, gti, etc.) are saved into the meta dictionary.
Other Parameters:
no_longdoublebool
If True, reduce the precision of longdouble arrays to double precision.
This needs to be done in some cases, e.g. when the table is to be saved
in an architecture not supporting extended precision (e.g. ARM), but can
also be useful when an extended precision is not needed.
Array attributes (e.g. time, pi, energy, etc. for
EventList) are converted into columns, while meta attributes
(mjdref, gti, etc.) are saved into the ds.attrs dictionary.
Since pandas does not support n-D data, multi-dimensional arrays are
converted into columns before the conversion, with names <colname>_dimN_M_K etc.
See documentation of make_nd_into_arrays for details.
Array attributes (e.g. time, pi, energy, etc. for
EventList) are converted into columns, while meta attributes
(mjdref, gti, etc.) are saved into the ds.attrs dictionary.
any other formats compatible with the writers in
astropy.table.Table (ascii.ecsv, hdf5, etc.)
..note:
Complex values can be dealt with out-of-the-box in some formats
like HDF5 or FITS, not in others (e.g. all ASCII formats).
With these formats, and in any case when fmt is ``None``, complex
values will be stored as two columns of real numbers, whose names
are of the format <variablename>.real and <variablename>.imag
Parameters:
filename: str
Name and path of the file to save the object list to.
fmt: str
The file format to store the data in.
Available options are pickle, hdf5, ascii, fits
All time series-like data classes inherit from stingray.StingrayTimeseries, which
implements most of the common functionality. The main data array is stored in the time
attribute.
Good Time Intervals (GTIs) are stored in the gti attribute, which is a list of 2-tuples or 2-lists
containing the start and stop times of each GTI. The gti attribute is not an array attribute, since
it is not related 1-to-1 to the main array, even if in some cases it might happen to have the same number
of elements of the main array. It is by default added to the not_array_attr attribute.
This can be events, binned light curves, unevenly sampled light curves, etc. The only
requirement is that the data (which can be any quantity, related or not to an electromagnetic
measurement) are associated with a time measurement.
We make a distinction between the array attributes, which have the same length of the
time array, and the meta attributes, which can be scalars or arrays of different
size. The array attributes can be multidimensional (e.g. a spectrum for each time bin),
but their first dimension (array.shape[0]) must have same length of the time array.
Array attributes are singled out automatically depending on their shape. All filtering
operations (e.g. apply_gtis, rebin, etc.) are applied to array attributes only.
For this reason, it is advisable to specify whether a given attribute should not be
considered as an array attribute by adding it to the not_array_attr list.
Parameters:
time: iterable
A list or array of time stamps
Other Parameters:
array_attrsdict
Array attributes to be set (e.g. {"flux":flux_array,"flux_err":flux_err_array}).
In principle, they could be specified as simple keyword arguments. But this way, we
will run a check on the length of the arrays, and raise an error if they are not of a
shape compatible with the time array.
dt: float
The time resolution of the time series. Can be a scalar or an array attribute (useful
for non-evenly sampled data or events from different instruments)
mjdreffloat
The MJD used as a reference for the time array.
gtis: ``[[gti0_0, gti0_1], [gti1_0, gti1_1], …]``
Good Time Intervals
high_precisionbool
Change the precision of self.time to float128. Useful while dealing with fast pulsars.
timerefstr
The time reference, as recorded in the FITS file (e.g. SOLARSYSTEM)
timesysstr
The time system, as recorded in the FITS file (e.g. TDB)
ephemstr
The JPL ephemeris used to barycenter the data, if any (e.g. DE430)
**other_kw
Used internally. Any other keyword arguments will be set as attributes of the object.
Attributes:
time: numpy.ndarray
The array of time stamps, in seconds from the reference
MJD defined in mjdref
not_array_attr: list
List of attributes that are never to be considered as array attributes. For example, GTIs
are not array attributes.
dt: float
The time resolution of the measurements. Can be a scalar or an array attribute (useful
for non-evenly sampled data or events from different instruments). It can also be 0, which
means that the time series is not evenly sampled and the effects of the time resolution are
considered negligible for the analysis. This is sometimes the case for events from
high-energy telescopes.
mjdreffloat
The MJD used as a reference for the time array.
gtis: ``[[gti0_0, gti0_1], [gti1_0, gti1_1], …]``
Good Time Intervals
high_precisionbool
Change the precision of self.time to float128. Useful while dealing with fast pulsars.
Analyze the light curve with any function, on a GTI-by-GTI base.
Parameters:
funcfunction
Function accepting a StingrayTimeseries object as single argument, plus
possible additional keyword arguments, and returning a number or a
tuple - e.g., (result,error) where both result and error are
numbers.
Returns:
start_timesarray
Lower time boundaries of all time segments.
stop_timesarray
upper time boundaries of all segments.
resultarray of N elements
The result of func for each segment of the light curve
Other Parameters:
fraction_stepfloat
By default, segments do not overlap (fraction_step = 1). If fraction_step < 1,
then the start points of consecutive segments are fraction_step*segment_size
apart, and consecutive segments overlap. For example, for fraction_step = 0.5,
the window shifts one half of segment_size)
kwargskeyword arguments
These additional keyword arguments, if present, they will be passed
to func
Analyze segments of the light curve with any function.
Parameters:
funcfunction
Function accepting a StingrayTimeseries object as single argument, plus
possible additional keyword arguments, and returning a number or a
tuple - e.g., (result,error) where both result and error are
numbers.
segment_sizefloat
Length in seconds of the light curve segments. If None, the full GTIs are considered
instead as segments.
Returns:
start_timesarray
Lower time boundaries of all time segments.
stop_timesarray
upper time boundaries of all segments.
resultarray of N elements
The result of func for each segment of the light curve
Other Parameters:
fraction_stepfloat
If the step is not a full segment_size but less (e.g. a moving window),
this indicates the ratio between step step and segment_size (e.g.
0.5 means that the window shifts of half segment_size)
kwargskeyword arguments
These additional keyword arguments, if present, they will be passed
to func
Examples
>>> importnumpyasnp>>> time=np.arange(0,10,0.1)>>> counts=np.zeros_like(time)+10>>> ts=StingrayTimeseries(time,counts=counts,dt=0.1)>>> # Define a function that calculates the mean>>> mean_func=lambdats:np.mean(ts.counts)>>> # Calculate the mean in segments of 5 seconds>>> start,stop,res=ts.analyze_segments(mean_func,5)>>> len(res)==2True>>> np.allclose(res,10)True
This method concatenates two or more StingrayTimeseries objects along the time
axis. GTIs are recalculated by merging all the GTIs together. GTIs should not overlap at
any point.
Estimate a reasonable segment length for segment-by-segment analysis.
The user has to specify a criterion based on a minimum number of counts (if
the time series has a counts attribute) or a minimum number of time samples.
At least one between min_counts and min_samples must be specified.
In the special case of a time series with dt=0 (event list-like, where each time
stamp correspond to a single count), the two definitions are equivalent.
Returns:
segment_sizefloat
The length of the light curve chunks that satisfies the conditions
Other Parameters:
min_countsint
Minimum number of counts for each chunk. Optional (but needs min_samples
if left unspecified). Only makes sense if the series has a counts attribute and
it is evenly sampled.
min_samplesint
Minimum number of time bins. Optional (but needs min_counts if left unspecified).
even_samplingbool
Force the treatment of the data as evenly sampled or not. If None, the data are
considered evenly sampled if self.dt is larger than zero and the median
separation between subsequent times is within 1% of self.dt.
This method is only appropriate for very short bad time intervals. The simulated data
are basically white noise, so they are able to alter the statistical properties of
variable data. For very short gaps in the data, the effect of these small
injections of white noise should be negligible. How short depends on the single case,
the user is urged not to use the method as a black box and make simulations to measure
its effect. If you have long bad time intervals, you should use more advanced
techniques, not currently available in Stingray for this use case, such as Gaussian
Processes. In particular, please verify that the values of max_length and
buffer_size are adequate to your case.
To fill the gaps in all but the time points (i.e., flux measures, energies), we take the
buffer_size (by default, the largest value between 100 and the estimated samples in
a max_length-long gap) valid data points closest to the gap and repeat them randomly
with the same empirical statistical distribution. So, if the my_fancy_attr attribute, in
the 100 points of the buffer, has 30 times 10, 10 times 9, and 60 times 11, there will be
on average 30% of 10, 60% of 11, and 10% of 9 in the simulated data.
Times are treated differently depending on the fact that the time series is evenly
sampled or not. If it is not, the times are simulated from a uniform distribution with the
same count rate found in the buffer. Otherwise, times just follow the same grid used
inside GTIs. Using the evenly sampled or not is decided based on the even_sampling
parameter. If left to None, the time series is considered evenly sampled if
self.dt is greater than zero and the median separation between subsequent times is
within 1% of the time resolution.
Other Parameters:
max_lengthfloat
Maximum length of a bad time interval to be filled. If None, the criterion is bad
time intervals shorter than 1/100th of the longest good time interval.
attrs_to_randomizelist of str, default None
List of array_attrs to randomize. IfNone, all array_attrs are randomized.
It should not include time and _mask, which are treated separately.
buffer_sizeint, default 100
Number of good data points to use to calculate the means and variance the random data
on each side of the bad time interval
even_samplingbool, default None
Force the treatment of the data as evenly sampled or not. If None, the data are
considered evenly sampled if self.dt is larger than zero and the median
separation between subsequent times is within 1% of self.dt.
seedint, default None
Random seed to use for the simulation. If None, a random seed is generated.
The timeseries has to define at least a column called time,
the rest of columns will form the array attributes of the
new time series, while the attributes in table.meta will
form the new meta attributes of the time series.
Standard attributes such as pi and energy remain None if they are None
in both. Otherwise, np.nan is used as a default value for the missing values.
Arbitrary array attributes are created and joined using the same convention.
Multiple checks are done on the joined time series. If the time array of the series
being joined is empty, it is ignored. If the time resolution is different, the final
time series will have the rougher time resolution. If the MJDREF is different, the time
reference will be changed to the one of the first time series. An empty time series will
be ignored.
Note: join is not equivalent to concatenate. concatenate is used to join
multiple non-overlapping time series along the time axis, while join is more
general, and can be used to join multiple time series with different strategies (see
parameter strategy below).
The other StingrayTimeseries object which is supposed to be joined with.
If other is a list, it is assumed to be a list of StingrayTimeseries
and they are all joined, one by one.
Method to use to merge the GTIs. If “intersection”, the GTIs are merged
using the intersection of the GTIs. If “union”, the GTIs are merged
using the union of the GTIs. If “none”, a single GTI with the minimum and
the maximum time stamps of all GTIs is returned. If “infer”, the strategy
is decided based on the GTIs. If there are no overlaps, “union” is used,
otherwise “intersection” is used. If “append”, the GTIs are simply appended
but they must be mutually exclusive.
Plot the time series object on a graph self.time on x-axis and
self.counts on y-axis with self.counts_err optionally
as error bars.
Parameters:
attr: str
Attribute to plot.
Other Parameters:
witherrors: boolean, default False
Whether to plot the StingrayTimeseries with errorbars or not
labelsiterable, default None
A list or tuple with xlabel and ylabel as strings. E.g.
if the attribute is 'counts', the list of labels
could be ['Time(s)','Counts(s^-1)']
axmatplotlib.pyplot.axis object
Axis to be used for plotting. Defaults to creating a new one.
axis_limitslist, tuple, string, default None
Parameter to set axis properties of the matplotlib figure. For example
it can be a list like [xmin,xmax,ymin,ymax] or any other
acceptable argument for the``matplotlib.pyplot.axis()`` method.
titlestr, default None
The title of the plot.
markerstr, default ‘-’
Line style and color of the plot. Line styles and colors are
combined in a single format string, as in 'bo' for blue
circles. See matplotlib.pyplot.plot for more options.
saveboolean, optional, default False
If True, save the figure with specified filename.
filenamestr
File name of the image to save. Depends on the boolean save.
plot_btisbool
Plot the bad time intervals as red areas on the plot
Rebin the time series to a new time resolution. While the new
resolution need not be an integer multiple of the previous time
resolution, be aware that if it is not, the last bin will be cut
off by the fraction left over by the integer division.
Parameters:
dt_new: float
The new time resolution of the time series. Must be larger than
the time resolution of the old time series!
A StingrayTimeseries can be sorted in either increasing or decreasing order
using this method. The time array gets sorted and the counts array is
changed accordingly.
Parameters:
reverseboolean, default False
If True then the object is sorted in reverse order.
inplacebool
If True, overwrite the current time series. Otherwise, return a new one.
Split the current StingrayTimeseries object into a list of
StingrayTimeseries objects, one for each continuous GTI segment
as defined in the gti attribute.
Parameters:
min_pointsint, default 1
The minimum number of data points in each time series. Light
curves with fewer data points will be ignored.
This method takes a start and a stop point (either as indices,
or as times in the same unit as those in the time attribute, and truncates
all bins before start and after stop, then returns a new
StingrayTimeseries object with the truncated time series.
Parameters:
startint, default 0
Index (or time stamp) of the starting point of the truncation. If no value is set
for the start point, then all points from the first element in the time array
are taken into account.
stopint, default None
Index (or time stamp) of the ending point (exclusive) of the truncation. If no
value of stop is set, then points including the last point in
the counts array are taken in count.
method{index | time}, optional, default index
Type of the start and stop values. If set to index then
the values are treated as indices of the counts array, or
if set to time, the values are treated as actual time values.
>>> time=[1,2,3,4,5,6,7,8,9]>>> count=[10,20,30,40,50,60,70,80,90]>>> ts=StingrayTimeseries(time,array_attrs={"counts":count},dt=1)>>> ts_new=ts.truncate(start=2,stop=8)>>> assertnp.allclose(ts_new.counts,[30,40,50,60,70,80])>>> assertnp.allclose(ts_new.time,[3,4,5,6,7,8])>>> # Truncation can also be done by time values>>> ts_new=ts.truncate(start=6,method='time')>>> assertnp.allclose(ts_new.time,[6,7,8,9])>>> assertnp.allclose(ts_new.counts,[60,70,80,90])
Make a light curve object from an array of time stamps and an
array of counts.
Parameters:
time: Iterable, `:class:astropy.time.Time`, or `:class:astropy.units.Quantity` object
A list or array of time stamps for a light curve. Must be a type that
can be cast to :class:np.array or :class:List of floats, or that
has a value attribute that does (e.g. a
:class:astropy.units.Quantity or :class:astropy.time.Time object).
counts: iterable, optional, default ``None``
A list or array of the counts in each bin corresponding to the
bins defined in time (note: use input_counts=False to
input the count range, i.e. counts/second, otherwise use
counts/bin).
err: iterable, optional, default ``None``
A list or array of the uncertainties in each bin corresponding to
the bins defined in time (note: use input_counts=False to
input the count rage, i.e. counts/second, otherwise use
counts/bin). If None, we assume the data is poisson distributed
and calculate the error from the average of the lower and upper
1-sigma confidence intervals for the Poissonian distribution with
mean equal to counts.
input_counts: bool, optional, default True
If True, the code assumes that the input data in counts
is in units of counts/bin. If False, it assumes the data
in counts is in counts/second.
gti: 2-d float array, default ``None``
[[gti0_0,gti0_1],[gti1_0,gti1_1],...]
Good Time Intervals. They are not applied to the data by default.
They will be used by other methods to have an indication of the
“safe” time intervals to use during analysis.
err_dist: str, optional, default ``None``
Statistical distribution used to calculate the
uncertainties and other statistical values appropriately.
Default makes no assumptions and keep errors equal to zero.
bg_counts: iterable,`:class:numpy.array` or `:class:List` of floats, optional, default ``None``
A list or array of background counts detected in the background extraction region
in each bin corresponding to the bins defined in time.
bg_ratio: iterable, `:class:numpy.array` or `:class:List` of floats, optional, default ``None``
A list or array of source region area to background region area ratio in each bin. These are
factors by which the bg_counts should be scaled to estimate background counts within the
source aperture.
frac_exp: iterable, `:class:numpy.array` or `:class:List` of floats, optional, default ``None``
A list or array of fractional exposers in each bin.
mjdref: float
MJD reference (useful in most high-energy mission data)
dt: float or array of floats. Default median(diff(time))
Time resolution of the light curve. Can be an array of the same dimension
as time specifying width of each bin.
skip_checks: bool
If True, the user specifies that data are already sorted and contain no
infinite or nan points. Use at your own risk
low_memory: bool
If True, all the lazily evaluated attribute (e.g., countrate and
countrate_err if input_counts is True) will _not_ be stored in memory,
but calculated every time they are requested.
missionstr
Mission that recorded the data (e.g. NICER)
instrstr
Instrument onboard the mission
headerstr
The full header of the original FITS file, if relevant
**other_kw
Used internally. Any other keyword arguments will be ignored
Attributes:
time: numpy.ndarray
The array of midpoints of time bins.
bin_lo: numpy.ndarray
The array of lower time stamp of time bins.
bin_hi: numpy.ndarray
The array of higher time stamp of time bins.
counts: numpy.ndarray
The counts per bin corresponding to the bins in time.
counts_err: numpy.ndarray
The uncertainties corresponding to counts
bg_counts: numpy.ndarray
The background counts corresponding to the bins in time.
bg_ratio: numpy.ndarray
The ratio of source region area to background region area corresponding to each bin.
frac_exp: numpy.ndarray
The fractional exposers in each bin.
countrate: numpy.ndarray
The counts per second in each of the bins defined in time.
countrate_err: numpy.ndarray
The uncertainties corresponding to countrate
meanrate: float
The mean count rate of the light curve.
meancounts: float
The mean counts of the light curve.
n: int
The number of data points in the light curve.
dt: float or array of floats
The time resolution of the light curve.
mjdref: float
MJD reference date (tstart / 86400 gives the date in MJD at the
start of the observation)
tseg: float
The total duration of the light curve.
tstart: float
The start time of the light curve.
gti: 2-d float array
[[gti0_0,gti0_1],[gti1_0,gti1_1],...]
Good Time Intervals. They indicate the “safe” time intervals
to be used during the analysis of the light curve.
err_dist: string
Statistic of the Lightcurve, it is used to calculate the
uncertainties and other statistical values appropriately.
It propagates to Spectrum classes.
missionstr
Mission that recorded the data (e.g. NICER)
instrstr
Instrument onboard the mission
detector_iditerable
The detector that recoded each photon, if relevant (e.g. XMM, Chandra)
headerstr
The full header of the original FITS file, if relevant
Analyze segments of the light curve with any function.
Deprecated since version 2.0: Use Lightcurve.analyze_segments(func,segment_size)() instead.
Parameters:
segment_sizefloat
Length in seconds of the light curve segments
funcfunction
Function accepting a Lightcurve object as single argument, plus
possible additional keyword arguments, and returning a number or a
tuple - e.g., (result,error) where both result and error are
numbers.
Returns:
start_timesarray
Lower time boundaries of all time segments.
stop_timesarray
upper time boundaries of all segments.
resultarray of N elements
The result of func for each segment of the light curve
Other Parameters:
fraction_stepfloat
By default, segments do not overlap (fraction_step = 1). If fraction_step < 1,
then the start points of consecutive segments are fraction_step*segment_size
apart, and consecutive segments overlap. For example, for fraction_step = 0.5,
the window shifts one half of segment_size)
kwargskeyword arguments
These additional keyword arguments, if present, they will be passed
to func
Apply GTIs to a light curve. Filters the time, counts,
countrate, counts_err and countrate_err arrays for all bins
that fall into Good Time Intervals and recalculates mean countrate
and the number of bins.
Parameters:
inplacebool
If True, overwrite the current light curve. Otherwise, return a new one.
Calculate the baseline of the light curve, accounting for GTIs.
Parameters:
lamfloat
“smoothness” parameter. Larger values make the baseline stiffer
Typically 1e2<lam<1e9
pfloat
“asymmetry” parameter. Smaller values make the baseline more
“horizontal”. Typically 0.001<p<0.1, but not necessary.
Returns:
baselinenumpy.ndarray
An array with the baseline of the light curve
Other Parameters:
offset_correctionbool, default False
by default, this method does not align to the running mean of the
light curve, but it goes below the light curve. Setting align to
True, an additional step is done to shift the baseline so that it
is shifted to the middle of the light curve noise distribution.
Finds posterior samples of Bayesian excess variance (bexvar) for the light curve.
It requires source counts in counts and time intervals for each bin.
If the dt is an array then uses its elements as time intervals
for each bin. If dt is float, it calculates the time intervals by assuming
all intervals to be equal to dt.
Returns:
lc_bexvariterable, :class:numpy.array of floats
An array of posterior samples of Bayesian excess variance (bexvar).
Estimate a reasonable segment length for segment-by-segment analysis.
The user has to specify a criterion based on a minimum number of counts (if
the time series has a counts attribute) or a minimum number of time samples.
At least one between min_counts and min_samples must be specified.
Returns:
segment_sizefloat
The length of the light curve chunks that satisfies the conditions
Other Parameters:
min_countsint
Minimum number of counts for each chunk. Optional (but needs min_samples
if left unspecified). Only makes sense if the series has a counts attribute and
it is evenly sampled.
min_samplesint
Minimum number of time bins. Optional (but needs min_counts if left unspecified).
even_samplingbool
Force the treatment of the data as evenly sampled or not. If None, the data are
considered evenly sampled if self.dt is larger than zero and the median
separation between subsequent times is within 1% of self.dt.
Create a Stingray Object object from data in an Astropy Table.
The table MUST contain at least a column named like the
main_array_attr.
The rest of columns will form the array attributes of the
new object, while the attributes in ds.attrs will
form the new meta attributes of the object.
The timeseries has to define at least a column called time,
the rest of columns will form the array attributes of the
new time series, while the attributes in table.meta will
form the new meta attributes of the time series.
The new Lightcurve object will contain time stamps from both the
objects. The counts and countrate attributes in the resulting object
will contain the union of the non-overlapping parts of the two individual objects,
or the average in case of overlapping time arrays of both Lightcurve objects.
Good Time Intervals are also joined.
Note : Ideally, the time array of both lightcurves should not overlap.
Make a light curve out of photon arrival times, with a given time resolution dt.
Note that dt should be larger than the native time resolution of the instrument
that has taken the data.
Parameters:
toa: iterable
list of photon arrival times
dt: float
time resolution of the light curve (the bin width)
tseg: float, optional, default ``None``
The total duration of the light curve.
If this is None, then the total duration of the light curve will
be the interval between the arrival between either the first and the last
gti boundary or, if gti is not set, the first and the last photon in toa.
Note: If tseg is not divisible by dt (i.e. if tseg/dt is
not an integer number), then the last fractional bin will be
dropped!
tstart: float, optional, default ``None``
The start time of the light curve.
If this is None, either the first gti boundary or, if not available,
the arrival time of the first photon will be used
as the start time of the light curve.
gti: 2-d float array
[[gti0_0,gti0_1],[gti1_0,gti1_1],...]
Good Time Intervals
use_histbool
Use np.histogram instead of np.bincounts. Might be advantageous
for very short datasets.
Plot the light curve object on a graph self.time on x-axis and
self.counts on y-axis with self.counts_err optionally
as error bars.
Parameters:
witherrors: boolean, default False
Whether to plot the Lightcurve with errorbars or not
labelsiterable, default None
A list of tuple with xlabel and ylabel as strings.
axis_limitslist, tuple, string, default None
Parameter to set axis properties of the matplotlib figure. For example
it can be a list like [xmin,xmax,ymin,ymax] or any other
acceptable argument for the``matplotlib.pyplot.axis()`` method.
axislist, tuple, string, default None
Deprecated in favor of axis_limits, same functionality.
titlestr, default None
The title of the plot.
markerstr, default ‘-’
Line style and color of the plot. Line styles and colors are
combined in a single format string, as in 'bo' for blue
circles. See matplotlib.pyplot.plot for more options.
saveboolean, optional, default False
If True, save the figure with specified filename.
filenamestr
File name of the image to save. Depends on the boolean save.
axmatplotlib.pyplot.axis object
Axis to be used for plotting. Defaults to creating a new one.
plot_btisbool
Plot the bad time intervals as red areas on the plot
hea : FITS Light curves from HEASARC-supported missions.
any other formats compatible with the writers in
astropy.table.Table (ascii.ecsv, hdf5, etc.)
Files that need the astropy.table.Table interface MUST contain
at least a time column and a counts or countrate column.
The default ascii format is enhanced CSV (ECSV). Data formats
supporting the serialization of metadata (such as ECSV and HDF5) can
contain all lightcurve attributes such as dt, gti, etc with
no significant loss of information. Other file formats might lose part
of the metadata, so must be used with care.
Parameters:
filename: str
Path and file name for the file to be read.
fmt: str
Available options are ‘pickle’, ‘hea’, and any Table-supported
format such as ‘hdf5’, ‘ascii.ecsv’, etc.
Default error distribution if not specified in the file (e.g. for
ASCII files). The default is ‘gauss’ just because it is likely
that people using ASCII light curves will want to specify Gaussian
error bars, if any.
Rebin the light curve to a new time resolution. While the new
resolution need not be an integer multiple of the previous time
resolution, be aware that if it is not, the last bin will be cut
off by the fraction left over by the integer division.
Parameters:
dt_new: float
The new time resolution of the light curve. Must be larger than
the time resolution of the old light curve!
A Lightcurve can be sorted in either increasing or decreasing order
using this method. The time array gets sorted and the counts array is
changed accordingly.
Parameters:
reverseboolean, default False
If True then the object is sorted in reverse order.
inplacebool
If True, overwrite the current light curve. Otherwise, return a new one.
Sort a Lightcurve object in accordance with its counts array.
A Lightcurve can be sorted in either increasing or decreasing order
using this method. The counts array gets sorted and the time array is
changed accordingly.
Parameters:
reverseboolean, default False
If True then the object is sorted in reverse order.
inplacebool
If True, overwrite the current light curve. Otherwise, return a new one.
For data with gaps, it can sometimes be useful to be able to split
the light curve into separate, evenly sampled objects along those
data gaps. This method allows to do this: it finds data gaps of a
specified minimum size, and produces a list of new Lightcurve
objects for each contiguous segment.
Parameters:
min_gapfloat
The length of a data gap, in the same units as the time attribute
of the Lightcurve object. Any smaller gaps will be ignored, any
larger gaps will be identified and used to split the light curve.
min_pointsint, default 1
The minimum number of data points in each light curve. Light
curves with fewer data points will be ignored.
The time array and all the array attributes become columns. The meta attributes become
metadata of the astropy.table.Table object.
Other Parameters:
no_longdoublebool, default False
If True, the data are converted to double precision before being saved.
This is useful, e.g., for saving to FITS files, which do not support long double precision.
The time array and all the array attributes become columns. The meta attributes become
metadata of the astropy.timeseries.TimeSeries object.
The time array is saved as a TimeDelta object.
Other Parameters:
no_longdoublebool, default False
If True, the data are converted to double precision before being saved.
This is useful, e.g., for saving to FITS files, which do not support long double precision.
Returns a lightkurve.LightCurve object.
This feature requires Lightkurve to be installed
(e.g. pipinstalllightkurve). An ImportError will
be raised if this package is not available.
This method takes a start and a stop point (either as indices,
or as times in the same unit as those in the time attribute, and truncates
all bins before start and after stop, then returns a new Lightcurve
object with the truncated light curve.
Parameters:
startint, default 0
Index (or time stamp) of the starting point of the truncation. If no value is set
for the start point, then all points from the first element in the time array
are taken into account.
stopint, default None
Index (or time stamp) of the ending point (exclusive) of the truncation. If no
value of stop is set, then points including the last point in
the counts array are taken in count.
method{index | time}, optional, default index
Type of the start and stop values. If set to index then
the values are treated as indices of the counts array, or
if set to time, the values are treated as actual time values.
Basic class for event list data. Event lists generally correspond to individual events (e.g. photons)
recorded by the detector, and their associated properties. For X-ray data where this type commonly occurs,
events are time stamps of when a photon arrived in the detector, and (optionally) the photon energy associated
with the event.
Parameters:
time: iterable
A list or array of time stamps
Other Parameters:
dt: float
The time resolution of the events. Only relevant when using events
to produce light curves with similar bin time.
energy: iterable
A list of array of photon energy values in keV
mjdreffloat
The MJD used as a reference for the time array.
ncounts: int
Number of desired data points in event list. Deprecated
gtis: ``[[gti0_0, gti0_1], [gti1_0, gti1_1], …]``
Good Time Intervals
piinteger, numpy.ndarray
PI channels
notesstr
Any useful annotations
high_precisionbool
Change the precision of self.time to float128. Useful while dealing with fast pulsars.
missionstr
Mission that recorded the data (e.g. NICER)
instrstr
Instrument onboard the mission
headerstr
The full header of the original FITS file, if relevant
detector_iditerable
The detector that recorded each photon (if the instrument has more than
one, e.g. XMM/EPIC-pn)
timerefstr
The time reference, as recorded in the FITS file (e.g. SOLARSYSTEM)
timesysstr
The time system, as recorded in the FITS file (e.g. TDB)
ephemstr
The JPL ephemeris used to barycenter the data, if any (e.g. DE430)
**other_kw
Used internally. Any other keyword arguments will be ignored
Attributes:
time: numpy.ndarray
The array of event arrival times, in seconds from the reference
MJD defined in mjdref
energy: numpy.ndarray
The array of photon energy values
ncounts: int
The number of data points in the event list
dt: float
The time resolution of the events. Only relevant when using events
to produce light curves with similar bin time.
mjdreffloat
The MJD used as a reference for the time array.
gtis: ``[[gti0_0, gti0_1], [gti1_0, gti1_1], …]``
Good Time Intervals
piinteger, numpy.ndarray
PI channels
high_precisionbool
Change the precision of self.time to float128. Useful while dealing with fast pulsars.
missionstr
Mission that recorded the data (e.g. NICER)
instrstr
Instrument onboard the mission
detector_iditerable
The detector that recoded each photon, if relevant (e.g. XMM, Chandra)
headerstr
The full header of the original FITS file, if relevant
If both are empty, an empty EventList is returned.
GTIs are crossed if the event lists are over a common time interval,
and appended otherwise.
Standard attributes such as pi and energy remain None if they are None
in both. Otherwise, np.nan is used as a default value for the EventList where
they were None. Arbitrary attributes (e.g., Stokes parameters in polarimetric data) are
created and joined using the same convention.
Multiple checks are done on the joined event lists. If the time array of the event list
being joined is empty, it is ignored. If the time resolution is different, the final
event list will have the rougher time resolution. If the MJDREF is different, the time
reference will be changed to the one of the first event list. An empty event list will
be ignored.
The other EventList object which is supposed to be joined with.
If other is a list, it is assumed to be a list of EventList objects
and they are all joined, one by one.
Method to use to merge the GTIs. If “intersection”, the GTIs are merged
using the intersection of the GTIs. If “union”, the GTIs are merged
using the union of the GTIs. If “none”, a single GTI with the minimum and
the maximum time stamps of all GTIs is returned. If “infer”, the strategy
is decided based on the GTIs. If there are no overlaps, “union” is used,
otherwise “intersection” is used. If “append”, the GTIs are simply appended
but they must be mutually exclusive.
hea or ogip : FITS Event files from (well, some) HEASARC-supported missions.
any other formats compatible with the writers in
astropy.table.Table (ascii.ecsv, hdf5, etc.)
Files that need the astropy.table.Table interface MUST contain
at least a time column. Other recognized columns are energy and
pi.
The default ascii format is enhanced CSV (ECSV). Data formats
supporting the serialization of metadata (such as ECSV and HDF5) can
contain all eventlist attributes such as mission, gti, etc with
no significant loss of information. Other file formats might lose part
of the metadata, so must be used with care.
Parameters:
filename: str
Path and file name for the file to be read.
fmt: str
Available options are ‘pickle’, ‘hea’, and any Table-supported
format such as ‘hdf5’, ‘ascii.ecsv’, etc.
Assign (simulate) energies to event list from a spectrum.
Parameters:
spectrum: 2-d array or list [energies, spectrum]
Energies versus corresponding fluxes. The 2-d array or list must
have energies across the first dimension and fluxes across the
second one. If the dimension of the energies is the same as
spectrum, they are interpreted as bin centers.
If it is longer by one, they are interpreted as proper bin edges
(similarly to the bins of np.histogram).
Note that for non-uniformly binned spectra, it is advisable to pass
the exact edges.
The result will be something similar to a light curve, but with arbitrary
attributes corresponding to a weighted sum of each specified attribute of
the event list.
E.g. if the event list has a q attribute, the final time series will
have a q attribute, which is the sum of all q values in each time bin.
These classes implement commonly used Fourier analysis products, most importantly Crossspectrum and
Powerspectrum, along with the variants for averaged cross/power spectra.
Compute the classical significances for the powers in the power
spectrum, assuming an underlying noise distribution that follows a
chi-square distributions with 2M degrees of freedom, where M is the
number of powers averaged in each bin.
Note that this function will only produce correct results when the
following underlying assumptions are fulfilled:
The power spectrum is Leahy-normalized
There is no source of variability in the data other than the
periodic signal to be determined with this method. This is important!
If there are other sources of (aperiodic) variability in the data, this
method will not produce correct results, but instead produce a large
number of spurious false positive detections!
There are no significant instrumental effects changing the
statistical distribution of the powers (e.g. pile-up or dead time)
By default, the method produces (index,p-values) for all powers in
the power spectrum, where index is the numerical index of the power in
question. If a threshold is set, then only powers with p-values
below that threshold with their respective indices. If
trial_correction is set to True, then the threshold will be corrected
for the number of trials (frequencies) in the power spectrum before
being used.
Parameters:
thresholdfloat, optional, default 1
The threshold to be used when reporting p-values of potentially
significant powers. Must be between 0 and 1.
Default is 1 (all p-values will be reported).
trial_correctionbool, optional, default False
A Boolean flag that sets whether the threshold will be corrected
by the number of frequencies before being applied. This decreases
the threshold (p-values need to be lower to count as significant).
Default is False (report all powers) though for any application
where threshold` is set to something meaningful, this should also
be applied!
Returns:
pvalsiterable
A list of (index,p-value) tuples for all powers that have p-values
lower than the threshold specified in threshold.
Coherence is defined in Vaughan and Nowak, 1996 [1].
It is a Fourier frequency dependent measure of the linear correlation
between time series measured simultaneously in two energy channels.
Calculate AveragedCrossspectrum from two event lists
Parameters:
events1stingray.EventList
Events from channel 1
events2stingray.EventList
Events from channel 2
dtfloat
The time resolution of the intermediate light curves
(sets the Nyquist frequency)
Other Parameters:
segment_sizefloat
The length, in seconds, of the light curve segments that will be averaged.
Only relevant (and required) for AveragedCrossspectrum
normstr, default “frac”
The normalization of the periodogram. “abs” is absolute rms, “frac” is
fractional rms, “leahy” is Leahy+83 normalization, and “none” is the
unnormalized periodogram
use_common_meanbool, default True
The mean of the light curve can be estimated in each interval, or on
the full light curve. This gives different results (Alston+2013).
Here we assume the mean is calculated on the full light curve, but
the user can set use_common_mean to False to calculate it on a
per-segment basis.
fullspecbool, default False
Return the full periodogram, including negative frequencies
silentbool, default False
Silence the progress bars
power_typestr, default ‘all’
If ‘all’, give complex powers. If ‘abs’, the absolute value; if ‘real’,
the real part
gti: [[gti0_0, gti0_1], [gti1_0, gti1_1], …]
Good Time intervals. Defaults to the common GTIs from the two input
objects. Could throw errors if these GTIs have overlaps with the
input object GTIs! If you’re getting errors regarding your GTIs,
don’t use this and only give GTIs to the input objects before
making the cross spectrum.
Light curves from channel 2. If arrays, use them as counts
dtfloat
The time resolution of the light curves
(sets the Nyquist frequency)
Other Parameters:
segment_sizefloat
The length, in seconds, of the light curve segments that will be averaged.
Only relevant (and required) for AveragedCrossspectrum
normstr, default “frac”
The normalization of the periodogram. “abs” is absolute rms, “frac” is
fractional rms, “leahy” is Leahy+83 normalization, and “none” is the
unnormalized periodogram
use_common_meanbool, default True
The mean of the light curve can be estimated in each interval, or on
the full light curve. This gives different results (Alston+2013).
Here we assume the mean is calculated on the full light curve, but
the user can set use_common_mean to False to calculate it on a
per-segment basis.
fullspecbool, default False
Return the full periodogram, including negative frequencies
silentbool, default False
Silence the progress bars
power_typestr, default ‘all’
If ‘all’, give complex powers. If ‘abs’, the absolute value; if ‘real’,
the real part
gti: [[gti0_0, gti0_1], [gti1_0, gti1_1], …]
Good Time intervals. Defaults to the common GTIs from the two input
objects. Could throw errors if these GTIs have overlaps with the
input object GTIs! If you’re getting errors regarding your GTIs,
don’t use this and only give GTIs to the input objects before
making the cross spectrum.
save_allbool, default False
If True, save the cross spectrum of each segment in the cs_all
attribute of the output Crossspectrum object.
The length, in seconds, of the light curve segments that will be averaged.
Only relevant (and required) for AveragedCrossspectrum
normstr, default “frac”
The normalization of the periodogram. “abs” is absolute rms, “frac” is
fractional rms, “leahy” is Leahy+83 normalization, and “none” is the
unnormalized periodogram
use_common_meanbool, default True
The mean of the light curve can be estimated in each interval, or on
the full light curve. This gives different results (Alston+2013).
Here we assume the mean is calculated on the full light curve, but
the user can set use_common_mean to False to calculate it on a
per-segment basis.
fullspecbool, default False
Return the full periodogram, including negative frequencies
silentbool, default False
Silence the progress bars
power_typestr, default ‘all’
If ‘all’, give complex powers. If ‘abs’, the absolute value; if ‘real’,
the real part
gti: [[gti0_0, gti0_1], [gti1_0, gti1_1], …]
Good Time intervals. Defaults to the common GTIs from the two input
objects. Could throw errors if these GTIs have overlaps with the
input object GTIs! If you’re getting errors regarding your GTIs,
don’t use this and only give GTIs to the input objects before
making the cross spectrum.
What attribute of the time series will be used as error bar.
segment_sizefloat
The length, in seconds, of the light curve segments that will be averaged.
Only relevant (and required) for AveragedCrossspectrum
normstr, default “frac”
The normalization of the periodogram. “abs” is absolute rms, “frac” is
fractional rms, “leahy” is Leahy+83 normalization, and “none” is the
unnormalized periodogram
use_common_meanbool, default True
The mean of the light curve can be estimated in each interval, or on
the full light curve. This gives different results (Alston+2013).
Here we assume the mean is calculated on the full light curve, but
the user can set use_common_mean to False to calculate it on a
per-segment basis.
fullspecbool, default False
Return the full periodogram, including negative frequencies
silentbool, default False
Silence the progress bars
power_typestr, default ‘all’
If ‘all’, give complex powers. If ‘abs’, the absolute value; if ‘real’,
the real part
gti: [[gti0_0, gti0_1], [gti1_0, gti1_1], …]
Good Time intervals. Defaults to the common GTIs from the two input
objects. Could throw errors if these GTIs have overlaps with the
input object GTIs! If you’re getting errors regarding your GTIs,
don’t use this and only give GTIs to the input objects before
making the cross spectrum.
Calculate AveragedCrossspectrum from two arrays of event times.
Parameters:
times1np.array
Event arrival times of channel 1
times2np.array
Event arrival times of channel 2
dtfloat
The time resolution of the intermediate light curves
(sets the Nyquist frequency)
Other Parameters:
segment_sizefloat
The length, in seconds, of the light curve segments that will be
averaged. Only relevant (and required) for AveragedCrossspectrum.
gti[[gti0, gti1], …]
Good Time intervals. Defaults to the common GTIs from the two input
objects. Could throw errors if these GTIs have overlaps with the
input object GTIs! If you’re getting errors regarding your GTIs,
don’t use this and only give GTIs to the input objects before
making the cross spectrum.
normstr, default “frac”
The normalization of the periodogram. “abs” is absolute rms, “frac” is
fractional rms, “leahy” is Leahy+83 normalization, and “none” is the
unnormalized periodogram
use_common_meanbool, default True
The mean of the light curve can be estimated in each interval, or on
the full light curve. This gives different results (Alston+2013).
Here we assume the mean is calculated on the full light curve, but
the user can set use_common_mean to False to calculate it on a
per-segment basis.
fullspecbool, default False
Return the full periodogram, including negative frequencies
silentbool, default False
Silence the progress bars
power_typestr, default ‘all’
If ‘all’, give complex powers. If ‘abs’, the absolute value; if ‘real’,
the real part
If norm is not a string, raise a TypeError
>>> Crossspectrum.initial_checks(c, norm=1)
Traceback (most recent call last):
…
TypeError: norm must be a string…
If norm is not one of the valid norms, raise a ValueError
>>> Crossspectrum.initial_checks(c, norm=”blabla”)
Traceback (most recent call last):
…
ValueError: norm must be ‘frac’…
If power_type is not one of the valid norms, raise a ValueError
>>> Crossspectrum.initial_checks(c, power_type=”blabla”)
Traceback (most recent call last):
…
ValueError: power_type not recognized!
If the user passes only one light curve, raise a ValueError
>>> Crossspectrum.initial_checks(c,data1=lc1,data2=None)Traceback (most recent call last):...ValueError: You can't do a cross spectrum...
If the user passes an event list without dt, raise a ValueError
>>> Crossspectrum.initial_checks(c,data1=ev1,data2=ev2,dt=None)Traceback (most recent call last):...ValueError: If using event lists, please specify...
Calculate the fourier phase lag of the cross spectrum.
This is defined as the argument of the complex cross spectrum, and gives
the delay at all frequencies, in cycles, of one input light curve with respect
to the other.
Plot the amplitude of the cross spectrum vs. the frequency using matplotlib.
Parameters:
labelsiterable, default None
A list of tuple with xlabel and ylabel as strings.
axislist, tuple, string, default None
Parameter to set axis properties of the matplotlib figure. For example
it can be a list like [xmin,xmax,ymin,ymax] or any other
acceptable argument for the``matplotlib.pyplot.axis()`` method.
titlestr, default None
The title of the plot.
markerstr, default ‘-’
Line style and color of the plot. Line styles and colors are
combined in a single format string, as in 'bo' for blue
circles. See matplotlib.pyplot.plot for more options.
saveboolean, optional, default False
If True, save the figure with specified filename.
filenamestr
File name of the image to save. Depends on the boolean save.
axmatplotlib.Axes object
An axes object to fill with the cross correlation plot.
Rebin the cross spectrum to a new frequency resolution df.
Parameters:
df: float
The new frequency resolution
Returns:
bin_cs = Crossspectrum (or one of its subclasses) object
The newly binned cross spectrum or power spectrum.
Note: this object will be of the same type as the object
that called this method. For example, if this method is called
from AveragedPowerspectrum, it will return an object of class
AveragedPowerspectrum, too.
Other Parameters:
f: float
the rebin factor. If specified, it substitutes df with f*self.df
Logarithmic rebin of the periodogram.
The new frequency depends on the previous frequency
modified by a factor f:
\[d\nu_j = d\nu_{j-1} (1+f)\]
Parameters:
f: float, optional, default ``0.01``
parameter that steers the frequency resolution
Returns:
new_specCrossspectrum (or one of its subclasses) object
The newly binned cross spectrum or power spectrum.
Note: this object will be of the same type as the object
that called this method. For example, if this method is called
from AveragedPowerspectrum, it will return an object of class
Make a cross spectrum from a (binned) light curve.
You can also make an empty Crossspectrum object to populate with your
own Fourier-transformed data (this can sometimes be useful when making
binned power spectra). Stingray uses the scipy.fft standards for the sign
of the Nyquist frequency.
Parameters:
data1: :class:`stingray.Lightcurve` or :class:`stingray.events.EventList`, optional, default ``None``
The dataset for the first channel/band of interest.
data2: :class:`stingray.Lightcurve` or :class:`stingray.events.EventList`, optional, default ``None``
The normalization of the (real part of the) cross spectrum.
power_type: string, optional, default ``real``
Parameter to choose among complete, real part and magnitude of the cross spectrum.
fullspec: boolean, optional, default ``False``
If False, keep only the positive frequencies, or if True, keep all of them .
Other Parameters:
gti: [[gti0_0, gti0_1], [gti1_0, gti1_1], …]
Good Time intervals. Defaults to the common GTIs from the two input
objects. Could throw errors if these GTIs have overlaps with the input
Lightcurve GTIs! If you’re getting errors regarding your GTIs, don’t
use this and only give GTIs to the Lightcurve objects before making
the cross spectrum.
lc1: :class:`stingray.Lightcurve`object OR iterable of :class:`stingray.Lightcurve` objects
The time resolution of the light curve. Only needed when constructing
light curves in the case where data1, data2 are
EventList objects
skip_checks: bool
Skip initial checks, for speed or other reasons (you need to trust your
inputs!)
Attributes:
freq: numpy.ndarray
The array of mid-bin frequencies that the Fourier transform samples
power: numpy.ndarray
The array of cross spectra (complex numbers)
power_err: numpy.ndarray
The uncertainties of power.
An approximation for each bin given by power_err=power/sqrt(m).
Where m is the number of power averaged in each bin (by frequency
binning, or averaging more than one spectra). Note that for a single
realization (m=1) the error is equal to the power.
df: float
The frequency resolution
m: int
The number of averaged cross-spectra amplitudes in each bin.
n: int
The number of data points/time bins in one segment of the light
curves.
k: array of int
The rebinning scheme if the object has been rebinned otherwise is set to 1.
Initialize the class, trying to understand the input types.
The input arguments are the same as __init__(). Based on the type
of data, this method will call the appropriate
powerspectrum_from_XXXX function, and initialize self with
the correct attributes.
Helper method to codify an operation of one time series with another (e.g. add, subtract).
Takes into account the GTIs, and returns a new StingrayTimeseries object.
An operation between the StingrayTimeseries object calling this method, and
other, operating on all the specified array attributes.
Returns:
ts_newStingrayTimeseries object
The new time series calculated in operation
Other Parameters:
operated_attrslist of str or None
Array attributes to be operated on. Defaults to all array attributes not ending in
_err.
The other array attributes will be discarded from the time series to avoid
inconsistencies.
error_attrslist of str or None
Array attributes to be operated on with error_operation. Defaults to all array
attributes ending with _err.
error_operationfunction
The function used for error propagation. Defaults to the sum of squares.
Compute the error on the fractional rms amplitude using error
propagation.
Note: this uses the actual measured powers, which is not
strictly correct. We should be using the underlying power spectrum,
but in the absence of an estimate of that, this will have to do.
\[r = \sqrt{P}\]
\[\begin{split}\delta r = \\frac{1}{2 * \sqrt{P}} \delta P\end{split}\]
Parameters:
powers: iterable
The list of powers used to compute the fractional rms amplitude.
Array attributes to be operated on. Defaults to all array attributes not ending in
_err.
The other array attributes will be discarded from the time series to avoid
inconsistencies.
error_attrslist of str or None
Array attributes to be operated on with error_operation. Defaults to all array
attributes ending with _err.
error_operationfunction
Function to be called to propagate the errors
inplacebool
If True, overwrite the current time series. Otherwise, return a new one.
Apply a mask to all array attributes of the object
Parameters:
maskarray of bool
The mask. Has to be of the same length as self.time
Returns:
ts_newStingrayObject object
The new object with the mask applied if inplace is False, otherwise the
same object.
Other Parameters:
inplacebool
If True, overwrite the current object. Otherwise, return a new one.
filtered_attrslist of str or None
Array attributes to be filtered. Defaults to all array attributes if None.
The other array attributes will be set to None. The main array attr is always
included.
Compute the classical significances for the powers in the power
spectrum, assuming an underlying noise distribution that follows a
chi-square distributions with 2M degrees of freedom, where M is the
number of powers averaged in each bin.
Note that this function will only produce correct results when the
following underlying assumptions are fulfilled:
The power spectrum is Leahy-normalized
There is no source of variability in the data other than the
periodic signal to be determined with this method. This is
important! If there are other sources of (aperiodic) variability in
the data, this method will not produce correct results, but
instead produce a large number of spurious false positive
detections!
There are no significant instrumental effects changing the
statistical distribution of the powers (e.g. pile-up or dead time)
By default, the method produces (index,p-values) for all powers in
the power spectrum, where index is the numerical index of the power in
question. If a threshold is set, then only powers with p-values
below that threshold with their respective indices. If
trial_correction is set to True, then the threshold will be
corrected for the number of trials (frequencies) in the power spectrum
before being used.
Parameters:
thresholdfloat, optional, default 1
The threshold to be used when reporting p-values of potentially
significant powers. Must be between 0 and 1.
Default is 1 (all p-values will be reported).
trial_correctionbool, optional, default False
A Boolean flag that sets whether the threshold will be
corrected by the number of frequencies before being applied. This
decreases the threshold (p-values need to be lower to count as
significant). Default is False (report all powers) though for
any application where threshold` is set to something meaningful,
this should also be applied!
Returns:
pvalsiterable
A list of (p-value,index) tuples for all powers that have
p-values lower than the threshold specified in threshold.
Coherence is defined in Vaughan and Nowak, 1996 [3].
It is a Fourier frequency dependent measure of the linear correlation
between time series measured simultaneously in two energy channels.
Compute the fractional rms amplitude in the power spectrum
between two frequencies.
Parameters:
min_freq: float
The lower frequency bound for the calculation.
max_freq: float
The upper frequency bound for the calculation.
Returns:
rms: float
The fractional rms amplitude contained between min_freq and
max_freq.
rms_err: float
The error on the fractional rms amplitude.
Other Parameters:
poisson_noise_levelfloat, default is None
This is the Poisson noise level of the PDS with same
normalization as the PDS. If poissoin_noise_level is None,
the Poisson noise is calculated in the idealcase
e.g. 2./<countrate> for fractional rms normalisation
Dead time and other instrumental effects can alter it.
The user can fit the Poisson noise level outside
this function using the same normalisation of the PDS
and it will get subtracted from powers here.
Clean up the list of attributes, only giving out those pointing to data.
List all the attributes that point directly to valid data. This method goes through all the
attributes of the class, eliminating methods, properties, and attributes that are complicated
to serialize such as other StingrayObject, or arrays of objects.
This function does not make difference between array-like data and scalar data.
Returns:
data_attributeslist of str
List of attributes pointing to data that are not methods, properties,
or other StingrayObject instances.
Create a Stingray Object object from data in an Astropy Table.
The table MUST contain at least a column named like the
main_array_attr.
The rest of columns will form the array attributes of the
new object, while the attributes in ds.attrs will
form the new meta attributes of the object.
Calculate an average power spectrum from an event list.
Parameters:
eventsstingray.EventList
Event list to be analyzed.
dtfloat
The time resolution of the intermediate light curves
(sets the Nyquist frequency).
Other Parameters:
segment_sizefloat
The length, in seconds, of the light curve segments that will be
averaged. Only relevant (and required) for
AveragedPowerspectrum.
gti: ``[[gti0_0, gti0_1], [gti1_0, gti1_1], …]``
Additional, optional Good Time intervals that get intersected with
the GTIs of the input object. Can cause errors if there are
overlaps between these GTIs and the input object GTIs. If that
happens, assign the desired GTIs to the input object.
normstr, default “frac”
The normalization of the periodogram. abs is absolute rms, frac
is fractional rms, leahy is Leahy+83 normalization, and none is
the unnormalized periodogram.
use_common_meanbool, default True
The mean of the light curve can be estimated in each interval, or
on the full light curve. This gives different results
(Alston+2013). By default, we assume the mean is calculated on the
full light curve, but the user can set use_common_mean to False
to calculate it on a per-segment basis.
silentbool, default False
Silence the progress bars.
save_allbool, default False
Save all intermediate PDSs used for the final average.
The time resolution of the light curves
(sets the Nyquist frequency)
Other Parameters:
segment_sizefloat
The length, in seconds, of the light curve segments that will be
averaged. Only relevant (and required) for
AveragedPowerspectrum.
gti: ``[[gti0_0, gti0_1], [gti1_0, gti1_1], …]``
Additional, optional Good Time intervals that get intersected with
the GTIs of the input object. Can cause errors if there are
overlaps between these GTIs and the input object GTIs. If that
happens, assign the desired GTIs to the input object.
normstr, default “frac”
The normalization of the periodogram. abs is absolute rms, frac
is fractional rms, leahy is Leahy+83 normalization, and none is
the unnormalized periodogram.
use_common_meanbool, default True
The mean of the light curve can be estimated in each interval, or
on the full light curve. This gives different results
(Alston+2013). By default, we assume the mean is calculated on the
full light curve, but the user can set use_common_mean to False
to calculate it on a per-segment basis.
silentbool, default False
Silence the progress bars.
save_allbool, default False
Save all intermediate PDSs used for the final average.
The time resolution of the intermediate light curves
(sets the Nyquist frequency).
Other Parameters:
segment_sizefloat
The length, in seconds, of the light curve segments that will be
averaged. Only relevant (and required) for
AveragedPowerspectrum.
gti: ``[[gti0_0, gti0_1], [gti1_0, gti1_1], …]``
Additional, optional Good Time intervals that get intersected with
the GTIs of the input object. Can cause errors if there are
overlaps between these GTIs and the input object GTIs. If that
happens, assign the desired GTIs to the input object.
normstr, default “frac”
The normalization of the periodogram. abs is absolute rms, frac
is fractional rms, leahy is Leahy+83 normalization, and none is
the unnormalized periodogram.
use_common_meanbool, default True
The mean of the light curve can be estimated in each interval, or
on the full light curve. This gives different results
(Alston+2013). By default, we assume the mean is calculated on the
full light curve, but the user can set use_common_mean to False
to calculate it on a per-segment basis.
silentbool, default False
Silence the progress bars.
save_allbool, default False
Save all intermediate PDSs used for the final average.
Create an StingrayObject object from data in a pandas DataFrame.
The dataframe MUST contain at least a column named like the
main_array_attr.
The rest of columns will form the array attributes of the
new object, while the attributes in ds.attrs will
form the new meta attributes of the object.
Since pandas does not support n-D data, multi-dimensional arrays can be
specified as <colname>_dimN_M_K etc.
See documentation of make_1d_arrays_into_nd for details.
What attribute of the time series will be used as error bar.
segment_sizefloat
The length, in seconds, of the light curve segments that will be averaged.
Only relevant (and required) for AveragedCrossspectrum
normstr, default “frac”
The normalization of the periodogram. “abs” is absolute rms, “frac” is
fractional rms, “leahy” is Leahy+83 normalization, and “none” is the
unnormalized periodogram
use_common_meanbool, default True
The mean of the light curve can be estimated in each interval, or on
the full light curve. This gives different results (Alston+2013).
Here we assume the mean is calculated on the full light curve, but
the user can set use_common_mean to False to calculate it on a
per-segment basis.
silentbool, default False
Silence the progress bars
gti: [[gti0_0, gti0_1], [gti1_0, gti1_1], …]
Good Time intervals. Defaults to the common GTIs from the two input
objects. Could throw errors if these GTIs have overlaps with the
input object GTIs! If you’re getting errors regarding your GTIs,
don’t use this and only give GTIs to the input objects before
making the cross spectrum.
save_allbool, default False
Save all intermediate PDSs used for the final average.
Calculate an average power spectrum from an array of event times.
Parameters:
timesnp.array
Event arrival times.
dtfloat
The time resolution of the intermediate light curves
(sets the Nyquist frequency).
Other Parameters:
segment_sizefloat
The length, in seconds, of the light curve segments that will be
averaged. Only relevant (and required) for
AveragedPowerspectrum.
gti: ``[[gti0_0, gti0_1], [gti1_0, gti1_1], …]``
Additional, optional Good Time intervals that get intersected with
the GTIs of the input object. Can cause errors if there are
overlaps between these GTIs and the input object GTIs. If that
happens, assign the desired GTIs to the input object.
normstr, default “frac”
The normalization of the periodogram. abs is absolute rms, frac
is fractional rms, leahy is Leahy+83 normalization, and none is
the unnormalized periodogram.
use_common_meanbool, default True
The mean of the light curve can be estimated in each interval, or
on the full light curve. This gives different results
(Alston+2013). By default, we assume the mean is calculated on the
full light curve, but the user can set use_common_mean to False
to calculate it on a per-segment basis.
The dataset MUST contain at least a column named like the
main_array_attr.
The rest of columns will form the array attributes of the
new object, while the attributes in ds.attrs will
form the new meta attributes of the object.
If norm is not a string, raise a TypeError
>>> Crossspectrum.initial_checks(c, norm=1)
Traceback (most recent call last):
…
TypeError: norm must be a string…
If norm is not one of the valid norms, raise a ValueError
>>> Crossspectrum.initial_checks(c, norm=”blabla”)
Traceback (most recent call last):
…
ValueError: norm must be ‘frac’…
If power_type is not one of the valid norms, raise a ValueError
>>> Crossspectrum.initial_checks(c, power_type=”blabla”)
Traceback (most recent call last):
…
ValueError: power_type not recognized!
If the user passes only one light curve, raise a ValueError
>>> Crossspectrum.initial_checks(c,data1=lc1,data2=None)Traceback (most recent call last):...ValueError: You can't do a cross spectrum...
If the user passes an event list without dt, raise a ValueError
>>> Crossspectrum.initial_checks(c,data1=ev1,data2=ev2,dt=None)Traceback (most recent call last):...ValueError: If using event lists, please specify...
List the names of the internal array attributes of the Stingray Object.
These are array attributes that can be set by properties, and are generally indicated
by an underscore followed by the name of the property that links to it (E.g.
_counts in Lightcurve).
By array attributes, we mean the ones with the same size and shape as
main_array_attr (e.g. time in EventList)
The formula used to calculate the upper limit assumes the Leahy
normalization.
If the periodogram is in another normalization, we will internally
convert it to Leahy before calculating the upper limit.
Parameters:
fmin: float
The minimum frequency to search (defaults to the first nonzero bin)
fmax: float
The maximum frequency to search (defaults to the Nyquist frequency)
Returns:
a: float
The modulation amplitude that could produce P>pmeas with 1 - c
probability.
Other Parameters:
c: float
The confidence value for the upper limit (e.g. 0.95 = 95%)
Examples
>>> pds=Powerspectrum()>>> pds.norm="leahy">>> pds.freq=np.arange(0.,5.)>>> # Note: this pds has 40 as maximum value between 2 and 5 Hz>>> pds.power=np.array([100000,1,1,40,1])>>> pds.m=1>>> pds.nphots=30000>>> assertnp.isclose(... pds.modulation_upper_limit(fmin=2,fmax=5,c=0.99),... 0.10164,... atol=0.0001)
Calculate the fourier phase lag of the cross spectrum.
This is defined as the argument of the complex cross spectrum, and gives
the delay at all frequencies, in cycles, of one input light curve with respect
to the other.
Plot the amplitude of the cross spectrum vs. the frequency using matplotlib.
Parameters:
labelsiterable, default None
A list of tuple with xlabel and ylabel as strings.
axislist, tuple, string, default None
Parameter to set axis properties of the matplotlib figure. For example
it can be a list like [xmin,xmax,ymin,ymax] or any other
acceptable argument for the``matplotlib.pyplot.axis()`` method.
titlestr, default None
The title of the plot.
markerstr, default ‘-’
Line style and color of the plot. Line styles and colors are
combined in a single format string, as in 'bo' for blue
circles. See matplotlib.pyplot.plot for more options.
saveboolean, optional, default False
If True, save the figure with specified filename.
filenamestr
File name of the image to save. Depends on the boolean save.
axmatplotlib.Axes object
An axes object to fill with the cross correlation plot.
Return a pretty-printed string representation of the object.
This is useful for debugging, and for interactive use.
Other Parameters:
func_to_applyfunction
A function that modifies the attributes listed in attrs_to_apply.
It must return the modified attributes and a label to be printed.
If None, no function is applied.
any other formats compatible with the writers in
astropy.table.Table (ascii.ecsv, hdf5, etc.)
Files that need the astropy.table.Table interface MUST contain
at least a column named like the main_array_attr.
The default ascii format is enhanced CSV (ECSV). Data formats
supporting the serialization of metadata (such as ECSV and HDF5) can
contain all attributes such as mission, gti, etc with
no significant loss of information. Other file formats might lose part
of the metadata, so must be used with care.
..note:
Complex values can be dealt with out-of-the-box in some formats
like HDF5 or FITS, not in others (e.g. all ASCII formats).
With these formats, and in any case when fmt is ``None``, complex
values should be stored as two columns of real numbers, whose names
are of the format <variablename>.real and <variablename>.imag
Parameters:
filename: str
Path and file name for the file to be read.
fmt: str
Available options are ‘pickle’, ‘hea’, and any Table-supported
format such as ‘hdf5’, ‘ascii.ecsv’, etc.
Logarithmic rebin of the periodogram.
The new frequency depends on the previous frequency
modified by a factor f:
\[d\nu_j = d\nu_{j-1} (1+f)\]
Parameters:
f: float, optional, default ``0.01``
parameter that steers the frequency resolution
Returns:
new_specCrossspectrum (or one of its subclasses) object
The newly binned cross spectrum or power spectrum.
Note: this object will be of the same type as the object
that called this method. For example, if this method is called
from AveragedPowerspectrum, it will return an object of class
Array attributes to be operated on. Defaults to all array attributes not ending in
_err.
The other array attributes will be discarded from the time series to avoid
inconsistencies.
error_attrslist of str or None
Array attributes to be operated on with error_operation. Defaults to all array
attributes ending with _err.
error_operationfunction
Function to be called to propagate the errors
inplacebool
If True, overwrite the current time series. Otherwise, return a new one.
Array attributes (e.g. time, pi, energy, etc. for
EventList) are converted into columns, while meta attributes
(mjdref, gti, etc.) are saved into the meta dictionary.
Other Parameters:
no_longdoublebool
If True, reduce the precision of longdouble arrays to double precision.
This needs to be done in some cases, e.g. when the table is to be saved
in an architecture not supporting extended precision (e.g. ARM), but can
also be useful when an extended precision is not needed.
Array attributes (e.g. time, pi, energy, etc. for
EventList) are converted into columns, while meta attributes
(mjdref, gti, etc.) are saved into the ds.attrs dictionary.
Since pandas does not support n-D data, multi-dimensional arrays are
converted into columns before the conversion, with names <colname>_dimN_M_K etc.
See documentation of make_nd_into_arrays for details.
Array attributes (e.g. time, pi, energy, etc. for
EventList) are converted into columns, while meta attributes
(mjdref, gti, etc.) are saved into the ds.attrs dictionary.
Make a Powerspectrum (also called periodogram) from a (binned)
light curve. Periodograms can be normalized by either Leahy normalization,
fractional rms normalization, absolute rms normalization, or not at all.
You can also make an empty Powerspectrum object to populate with
your own fourier-transformed data (this can sometimes be useful when making
binned power spectra).
The normaliation of the power spectrum to be used. Options are
“leahy”, “frac”, “abs” and “none”, default is “frac”.
Other Parameters:
gti: 2-d float array
[[gti0_0,gti0_1],[gti1_0,gti1_1],...] – Good Time intervals.
This choice overrides the GTIs in the single light curves. Use with
care, especially if these GTIs have overlaps with the input
object GTIs! If you’re getting errors regarding your GTIs, don’t
use this and only give GTIs to the input object before making
the power spectrum.
skip_checks: bool
Skip initial checks, for speed or other reasons (you need to trust your
inputs!).
Attributes:
norm: {“leahy” | “frac” | “abs” | “none” }
The normalization of the power spectrum.
freq: numpy.ndarray
The array of mid-bin frequencies that the Fourier transform samples.
power: numpy.ndarray
The array of normalized squared absolute values of Fourier
amplitudes.
power_err: numpy.ndarray
The uncertainties of power.
An approximation for each bin given by power_err=power/sqrt(m).
Where m is the number of power averaged in each bin (by frequency
binning, or averaging power spectra of segments of a light curve).
Note that for a single realization (m=1) the error is equal to the
power.
any other formats compatible with the writers in
astropy.table.Table (ascii.ecsv, hdf5, etc.)
..note:
Complex values can be dealt with out-of-the-box in some formats
like HDF5 or FITS, not in others (e.g. all ASCII formats).
With these formats, and in any case when fmt is ``None``, complex
values will be stored as two columns of real numbers, whose names
are of the format <variablename>.real and <variablename>.imag
Parameters:
filename: str
Name and path of the file to save the object list to.
fmt: str
The file format to store the data in.
Available options are pickle, hdf5, ascii, fits
Array attributes to be operated on. Defaults to all array attributes not ending in
_err.
The other array attributes will be discarded from the time series to avoid
inconsistencies.
error_attrslist of str or None
Array attributes to be operated on with error_operation. Defaults to all array
attributes ending with _err.
error_operationfunction
Function to be called to propagate the errors
inplacebool
If True, overwrite the current time series. Otherwise, return a new one.
Apply a mask to all array attributes of the object
Parameters:
maskarray of bool
The mask. Has to be of the same length as self.time
Returns:
ts_newStingrayObject object
The new object with the mask applied if inplace is False, otherwise the
same object.
Other Parameters:
inplacebool
If True, overwrite the current object. Otherwise, return a new one.
filtered_attrslist of str or None
Array attributes to be filtered. Defaults to all array attributes if None.
The other array attributes will be set to None. The main array attr is always
included.
Compute the classical significances for the powers in the power
spectrum, assuming an underlying noise distribution that follows a
chi-square distributions with 2M degrees of freedom, where M is the
number of powers averaged in each bin.
Note that this function will only produce correct results when the
following underlying assumptions are fulfilled:
The power spectrum is Leahy-normalized
There is no source of variability in the data other than the
periodic signal to be determined with this method. This is important!
If there are other sources of (aperiodic) variability in the data, this
method will not produce correct results, but instead produce a large
number of spurious false positive detections!
There are no significant instrumental effects changing the
statistical distribution of the powers (e.g. pile-up or dead time)
By default, the method produces (index,p-values) for all powers in
the power spectrum, where index is the numerical index of the power in
question. If a threshold is set, then only powers with p-values
below that threshold with their respective indices. If
trial_correction is set to True, then the threshold will be corrected
for the number of trials (frequencies) in the power spectrum before
being used.
Parameters:
thresholdfloat, optional, default 1
The threshold to be used when reporting p-values of potentially
significant powers. Must be between 0 and 1.
Default is 1 (all p-values will be reported).
trial_correctionbool, optional, default False
A Boolean flag that sets whether the threshold will be corrected
by the number of frequencies before being applied. This decreases
the threshold (p-values need to be lower to count as significant).
Default is False (report all powers) though for any application
where threshold` is set to something meaningful, this should also
be applied!
Returns:
pvalsiterable
A list of (index,p-value) tuples for all powers that have p-values
lower than the threshold specified in threshold.
Coherence is defined in Vaughan and Nowak, 1996 [4].
It is a Fourier frequency dependent measure of the linear correlation
between time series measured simultaneously in two energy channels.
Compute an averaged Coherence function of cross spectrum by computing
coherence function of each segment and averaging them. The return type
is a tuple with first element as the coherence function and the second
element as the corresponding uncertainty associated with it.
Note : The uncertainty in coherence function is strictly valid for Gaussian statistics only.
Returns:
(coh, uncertainty)tuple of np.ndarray
Tuple comprising the coherence function and uncertainty.
Clean up the list of attributes, only giving out those pointing to data.
List all the attributes that point directly to valid data. This method goes through all the
attributes of the class, eliminating methods, properties, and attributes that are complicated
to serialize such as other StingrayObject, or arrays of objects.
This function does not make difference between array-like data and scalar data.
Returns:
data_attributeslist of str
List of attributes pointing to data that are not methods, properties,
or other StingrayObject instances.
Create a Stingray Object object from data in an Astropy Table.
The table MUST contain at least a column named like the
main_array_attr.
The rest of columns will form the array attributes of the
new object, while the attributes in ds.attrs will
form the new meta attributes of the object.
Calculate AveragedCrossspectrum from two event lists
Parameters:
events1stingray.EventList
Events from channel 1
events2stingray.EventList
Events from channel 2
dtfloat
The time resolution of the intermediate light curves
(sets the Nyquist frequency)
Other Parameters:
segment_sizefloat
The length, in seconds, of the light curve segments that will be averaged.
Only relevant (and required) for AveragedCrossspectrum
normstr, default “frac”
The normalization of the periodogram. “abs” is absolute rms, “frac” is
fractional rms, “leahy” is Leahy+83 normalization, and “none” is the
unnormalized periodogram
use_common_meanbool, default True
The mean of the light curve can be estimated in each interval, or on
the full light curve. This gives different results (Alston+2013).
Here we assume the mean is calculated on the full light curve, but
the user can set use_common_mean to False to calculate it on a
per-segment basis.
fullspecbool, default False
Return the full periodogram, including negative frequencies
silentbool, default False
Silence the progress bars
power_typestr, default ‘all’
If ‘all’, give complex powers. If ‘abs’, the absolute value; if ‘real’,
the real part
gti: [[gti0_0, gti0_1], [gti1_0, gti1_1], …]
Good Time intervals. Defaults to the common GTIs from the two input
objects. Could throw errors if these GTIs have overlaps with the
input object GTIs! If you’re getting errors regarding your GTIs,
don’t use this and only give GTIs to the input objects before
making the cross spectrum.
Light curves from channel 2. If arrays, use them as counts
dtfloat
The time resolution of the light curves
(sets the Nyquist frequency)
Other Parameters:
segment_sizefloat
The length, in seconds, of the light curve segments that will be averaged.
Only relevant (and required) for AveragedCrossspectrum
normstr, default “frac”
The normalization of the periodogram. “abs” is absolute rms, “frac” is
fractional rms, “leahy” is Leahy+83 normalization, and “none” is the
unnormalized periodogram
use_common_meanbool, default True
The mean of the light curve can be estimated in each interval, or on
the full light curve. This gives different results (Alston+2013).
Here we assume the mean is calculated on the full light curve, but
the user can set use_common_mean to False to calculate it on a
per-segment basis.
fullspecbool, default False
Return the full periodogram, including negative frequencies
silentbool, default False
Silence the progress bars
power_typestr, default ‘all’
If ‘all’, give complex powers. If ‘abs’, the absolute value; if ‘real’,
the real part
gti: [[gti0_0, gti0_1], [gti1_0, gti1_1], …]
Good Time intervals. Defaults to the common GTIs from the two input
objects. Could throw errors if these GTIs have overlaps with the
input object GTIs! If you’re getting errors regarding your GTIs,
don’t use this and only give GTIs to the input objects before
making the cross spectrum.
save_allbool, default False
If True, save the cross spectrum of each segment in the cs_all
attribute of the output Crossspectrum object.
The length, in seconds, of the light curve segments that will be averaged.
Only relevant (and required) for AveragedCrossspectrum
normstr, default “frac”
The normalization of the periodogram. “abs” is absolute rms, “frac” is
fractional rms, “leahy” is Leahy+83 normalization, and “none” is the
unnormalized periodogram
use_common_meanbool, default True
The mean of the light curve can be estimated in each interval, or on
the full light curve. This gives different results (Alston+2013).
Here we assume the mean is calculated on the full light curve, but
the user can set use_common_mean to False to calculate it on a
per-segment basis.
fullspecbool, default False
Return the full periodogram, including negative frequencies
silentbool, default False
Silence the progress bars
power_typestr, default ‘all’
If ‘all’, give complex powers. If ‘abs’, the absolute value; if ‘real’,
the real part
gti: [[gti0_0, gti0_1], [gti1_0, gti1_1], …]
Good Time intervals. Defaults to the common GTIs from the two input
objects. Could throw errors if these GTIs have overlaps with the
input object GTIs! If you’re getting errors regarding your GTIs,
don’t use this and only give GTIs to the input objects before
making the cross spectrum.
Create an StingrayObject object from data in a pandas DataFrame.
The dataframe MUST contain at least a column named like the
main_array_attr.
The rest of columns will form the array attributes of the
new object, while the attributes in ds.attrs will
form the new meta attributes of the object.
Since pandas does not support n-D data, multi-dimensional arrays can be
specified as <colname>_dimN_M_K etc.
See documentation of make_1d_arrays_into_nd for details.
What attribute of the time series will be used as error bar.
segment_sizefloat
The length, in seconds, of the light curve segments that will be averaged.
Only relevant (and required) for AveragedCrossspectrum
normstr, default “frac”
The normalization of the periodogram. “abs” is absolute rms, “frac” is
fractional rms, “leahy” is Leahy+83 normalization, and “none” is the
unnormalized periodogram
use_common_meanbool, default True
The mean of the light curve can be estimated in each interval, or on
the full light curve. This gives different results (Alston+2013).
Here we assume the mean is calculated on the full light curve, but
the user can set use_common_mean to False to calculate it on a
per-segment basis.
fullspecbool, default False
Return the full periodogram, including negative frequencies
silentbool, default False
Silence the progress bars
power_typestr, default ‘all’
If ‘all’, give complex powers. If ‘abs’, the absolute value; if ‘real’,
the real part
gti: [[gti0_0, gti0_1], [gti1_0, gti1_1], …]
Good Time intervals. Defaults to the common GTIs from the two input
objects. Could throw errors if these GTIs have overlaps with the
input object GTIs! If you’re getting errors regarding your GTIs,
don’t use this and only give GTIs to the input objects before
making the cross spectrum.
Calculate AveragedCrossspectrum from two arrays of event times.
Parameters:
times1np.array
Event arrival times of channel 1
times2np.array
Event arrival times of channel 2
dtfloat
The time resolution of the intermediate light curves
(sets the Nyquist frequency)
Other Parameters:
segment_sizefloat
The length, in seconds, of the light curve segments that will be
averaged. Only relevant (and required) for AveragedCrossspectrum.
gti[[gti0, gti1], …]
Good Time intervals. Defaults to the common GTIs from the two input
objects. Could throw errors if these GTIs have overlaps with the
input object GTIs! If you’re getting errors regarding your GTIs,
don’t use this and only give GTIs to the input objects before
making the cross spectrum.
normstr, default “frac”
The normalization of the periodogram. “abs” is absolute rms, “frac” is
fractional rms, “leahy” is Leahy+83 normalization, and “none” is the
unnormalized periodogram
use_common_meanbool, default True
The mean of the light curve can be estimated in each interval, or on
the full light curve. This gives different results (Alston+2013).
Here we assume the mean is calculated on the full light curve, but
the user can set use_common_mean to False to calculate it on a
per-segment basis.
fullspecbool, default False
Return the full periodogram, including negative frequencies
silentbool, default False
Silence the progress bars
power_typestr, default ‘all’
If ‘all’, give complex powers. If ‘abs’, the absolute value; if ‘real’,
the real part
The dataset MUST contain at least a column named like the
main_array_attr.
The rest of columns will form the array attributes of the
new object, while the attributes in ds.attrs will
form the new meta attributes of the object.
If AveragedCrossspectrum, you need segment_size
>>> AveragedCrossspectrum.initial_checks(ac, data1=ev1, data2=ev2, dt=1)
Traceback (most recent call last):
…
ValueError: segment_size must be specified…
And it needs to be finite!
>>> AveragedCrossspectrum.initial_checks(ac, data1=ev1, data2=ev2, dt=1., segment_size=np.nan)
Traceback (most recent call last):
…
ValueError: segment_size must be finite!
List the names of the internal array attributes of the Stingray Object.
These are array attributes that can be set by properties, and are generally indicated
by an underscore followed by the name of the property that links to it (E.g.
_counts in Lightcurve).
By array attributes, we mean the ones with the same size and shape as
main_array_attr (e.g. time in EventList)
Plot the amplitude of the cross spectrum vs. the frequency using matplotlib.
Parameters:
labelsiterable, default None
A list of tuple with xlabel and ylabel as strings.
axislist, tuple, string, default None
Parameter to set axis properties of the matplotlib figure. For example
it can be a list like [xmin,xmax,ymin,ymax] or any other
acceptable argument for the``matplotlib.pyplot.axis()`` method.
titlestr, default None
The title of the plot.
markerstr, default ‘-’
Line style and color of the plot. Line styles and colors are
combined in a single format string, as in 'bo' for blue
circles. See matplotlib.pyplot.plot for more options.
saveboolean, optional, default False
If True, save the figure with specified filename.
filenamestr
File name of the image to save. Depends on the boolean save.
axmatplotlib.Axes object
An axes object to fill with the cross correlation plot.
Return a pretty-printed string representation of the object.
This is useful for debugging, and for interactive use.
Other Parameters:
func_to_applyfunction
A function that modifies the attributes listed in attrs_to_apply.
It must return the modified attributes and a label to be printed.
If None, no function is applied.
any other formats compatible with the writers in
astropy.table.Table (ascii.ecsv, hdf5, etc.)
Files that need the astropy.table.Table interface MUST contain
at least a column named like the main_array_attr.
The default ascii format is enhanced CSV (ECSV). Data formats
supporting the serialization of metadata (such as ECSV and HDF5) can
contain all attributes such as mission, gti, etc with
no significant loss of information. Other file formats might lose part
of the metadata, so must be used with care.
..note:
Complex values can be dealt with out-of-the-box in some formats
like HDF5 or FITS, not in others (e.g. all ASCII formats).
With these formats, and in any case when fmt is ``None``, complex
values should be stored as two columns of real numbers, whose names
are of the format <variablename>.real and <variablename>.imag
Parameters:
filename: str
Path and file name for the file to be read.
fmt: str
Available options are ‘pickle’, ‘hea’, and any Table-supported
format such as ‘hdf5’, ‘ascii.ecsv’, etc.
Rebin the cross spectrum to a new frequency resolution df.
Parameters:
df: float
The new frequency resolution
Returns:
bin_cs = Crossspectrum (or one of its subclasses) object
The newly binned cross spectrum or power spectrum.
Note: this object will be of the same type as the object
that called this method. For example, if this method is called
from AveragedPowerspectrum, it will return an object of class
AveragedPowerspectrum, too.
Other Parameters:
f: float
the rebin factor. If specified, it substitutes df with f*self.df
Logarithmic rebin of the periodogram.
The new frequency depends on the previous frequency
modified by a factor f:
\[d\nu_j = d\nu_{j-1} (1+f)\]
Parameters:
f: float, optional, default ``0.01``
parameter that steers the frequency resolution
Returns:
new_specCrossspectrum (or one of its subclasses) object
The newly binned cross spectrum or power spectrum.
Note: this object will be of the same type as the object
that called this method. For example, if this method is called
from AveragedPowerspectrum, it will return an object of class
Array attributes to be operated on. Defaults to all array attributes not ending in
_err.
The other array attributes will be discarded from the time series to avoid
inconsistencies.
error_attrslist of str or None
Array attributes to be operated on with error_operation. Defaults to all array
attributes ending with _err.
error_operationfunction
Function to be called to propagate the errors
inplacebool
If True, overwrite the current time series. Otherwise, return a new one.
Array attributes (e.g. time, pi, energy, etc. for
EventList) are converted into columns, while meta attributes
(mjdref, gti, etc.) are saved into the meta dictionary.
Other Parameters:
no_longdoublebool
If True, reduce the precision of longdouble arrays to double precision.
This needs to be done in some cases, e.g. when the table is to be saved
in an architecture not supporting extended precision (e.g. ARM), but can
also be useful when an extended precision is not needed.
Array attributes (e.g. time, pi, energy, etc. for
EventList) are converted into columns, while meta attributes
(mjdref, gti, etc.) are saved into the ds.attrs dictionary.
Since pandas does not support n-D data, multi-dimensional arrays are
converted into columns before the conversion, with names <colname>_dimN_M_K etc.
See documentation of make_nd_into_arrays for details.
Array attributes (e.g. time, pi, energy, etc. for
EventList) are converted into columns, while meta attributes
(mjdref, gti, etc.) are saved into the ds.attrs dictionary.
Make an averaged cross spectrum from a light curve by segmenting two
light curves, Fourier-transforming each segment and then averaging the
resulting cross spectra.
Parameters:
data1: :class:`stingray.Lightcurve`object OR iterable of :class:`stingray.Lightcurve` objects OR :class:`stingray.EventList` object
A light curve from which to compute the cross spectrum. In some cases,
this would be the light curve of the wavelength/energy/frequency band
of interest.
data2: :class:`stingray.Lightcurve`object OR iterable of :class:`stingray.Lightcurve` objects OR :class:`stingray.EventList` object
A second light curve to use in the cross spectrum. In some cases, this
would be the wavelength/energy/frequency reference band to compare the
band of interest with.
segment_size: float
The size of each segment to average. Note that if the total duration of
each Lightcurve object in lc1 or lc2 is not an
integer multiple of the segment_size, then any fraction left-over
at the end of the time series will be lost. Otherwise you introduce
artifacts.
The normalization of the (real part of the) cross spectrum.
Other Parameters:
gti: [[gti0_0, gti0_1], [gti1_0, gti1_1], …]
Good Time intervals. Defaults to the common GTIs from the two input
objects. Could throw errors if these GTIs have overlaps with the
input object GTIs! If you’re getting errors regarding your GTIs,
don’t use this and only give GTIs to the input objects before
making the cross spectrum.
dtfloat
The time resolution of the light curve. Only needed when constructing
light curves in the case where data1 or data2 are of :class:EventList
power_type: string, optional, default ``all``
Parameter to choose among complete, real part and magnitude of
the cross spectrum.
silentbool, default False
Do not show a progress bar when generating an averaged cross spectrum.
Useful for the batch execution of many spectra
lc1: :class:`stingray.Lightcurve`object OR iterable of :class:`stingray.Lightcurve` objects
If True, return the full array of frequencies, otherwise return just the
positive frequencies.
save_allbool, default False
Save all intermediate PDSs used for the final average. Use with care.
This is likely to fill up your RAM on medium-sized datasets, and to
slow down the computation when rebinning.
skip_checks: bool
Skip initial checks, for speed or other reasons (you need to trust your
inputs!)
use_common_mean: bool
Averaged cross spectra are normalized in two possible ways: one is by normalizing
each of the single spectra that get averaged, the other is by normalizing after the
averaging. If use_common_mean is selected, the spectrum will be normalized
after the average.
gti: [[gti0_0, gti0_1], [gti1_0, gti1_1], …]
Good Time intervals. Defaults to the common GTIs from the two input
objects. Could throw errors if these GTIs have overlaps with the
input object GTIs! If you’re getting errors regarding your GTIs,
don’t use this and only give GTIs to the input objects before
making the cross spectrum.
Attributes:
freq: numpy.ndarray
The array of mid-bin frequencies that the Fourier transform samples.
power: numpy.ndarray
The array of cross spectra.
power_err: numpy.ndarray
The uncertainties of power.
An approximation for each bin given by power_err=power/sqrt(m).
Where m is the number of power averaged in each bin (by frequency
binning, or averaging power spectra of segments of a light curve).
Note that for a single realization (m=1) the error is equal to the
power.
df: float
The frequency resolution.
m: int
The number of averaged cross spectra.
n: int
The number of time bins per segment of light curve.
nphots1: float
The total number of photons in the first (interest) light curve.
nphots2: float
The total number of photons in the second (reference) light curve.
any other formats compatible with the writers in
astropy.table.Table (ascii.ecsv, hdf5, etc.)
..note:
Complex values can be dealt with out-of-the-box in some formats
like HDF5 or FITS, not in others (e.g. all ASCII formats).
With these formats, and in any case when fmt is ``None``, complex
values will be stored as two columns of real numbers, whose names
are of the format <variablename>.real and <variablename>.imag
Parameters:
filename: str
Name and path of the file to save the object list to.
fmt: str
The file format to store the data in.
Available options are pickle, hdf5, ascii, fits
Array attributes to be operated on. Defaults to all array attributes not ending in
_err.
The other array attributes will be discarded from the time series to avoid
inconsistencies.
error_attrslist of str or None
Array attributes to be operated on with error_operation. Defaults to all array
attributes ending with _err.
error_operationfunction
Function to be called to propagate the errors
inplacebool
If True, overwrite the current time series. Otherwise, return a new one.
Apply a mask to all array attributes of the object
Parameters:
maskarray of bool
The mask. Has to be of the same length as self.time
Returns:
ts_newStingrayObject object
The new object with the mask applied if inplace is False, otherwise the
same object.
Other Parameters:
inplacebool
If True, overwrite the current object. Otherwise, return a new one.
filtered_attrslist of str or None
Array attributes to be filtered. Defaults to all array attributes if None.
The other array attributes will be set to None. The main array attr is always
included.
Compute the classical significances for the powers in the power
spectrum, assuming an underlying noise distribution that follows a
chi-square distributions with 2M degrees of freedom, where M is the
number of powers averaged in each bin.
Note that this function will only produce correct results when the
following underlying assumptions are fulfilled:
The power spectrum is Leahy-normalized
There is no source of variability in the data other than the
periodic signal to be determined with this method. This is
important! If there are other sources of (aperiodic) variability in
the data, this method will not produce correct results, but
instead produce a large number of spurious false positive
detections!
There are no significant instrumental effects changing the
statistical distribution of the powers (e.g. pile-up or dead time)
By default, the method produces (index,p-values) for all powers in
the power spectrum, where index is the numerical index of the power in
question. If a threshold is set, then only powers with p-values
below that threshold with their respective indices. If
trial_correction is set to True, then the threshold will be
corrected for the number of trials (frequencies) in the power spectrum
before being used.
Parameters:
thresholdfloat, optional, default 1
The threshold to be used when reporting p-values of potentially
significant powers. Must be between 0 and 1.
Default is 1 (all p-values will be reported).
trial_correctionbool, optional, default False
A Boolean flag that sets whether the threshold will be
corrected by the number of frequencies before being applied. This
decreases the threshold (p-values need to be lower to count as
significant). Default is False (report all powers) though for
any application where threshold` is set to something meaningful,
this should also be applied!
Returns:
pvalsiterable
A list of (p-value,index) tuples for all powers that have
p-values lower than the threshold specified in threshold.
Coherence is defined in Vaughan and Nowak, 1996 [5].
It is a Fourier frequency dependent measure of the linear correlation
between time series measured simultaneously in two energy channels.
Compute an averaged Coherence function of cross spectrum by computing
coherence function of each segment and averaging them. The return type
is a tuple with first element as the coherence function and the second
element as the corresponding uncertainty associated with it.
Note : The uncertainty in coherence function is strictly valid for Gaussian statistics only.
Returns:
(coh, uncertainty)tuple of np.ndarray
Tuple comprising the coherence function and uncertainty.
Compute the fractional rms amplitude in the power spectrum
between two frequencies.
Parameters:
min_freq: float
The lower frequency bound for the calculation.
max_freq: float
The upper frequency bound for the calculation.
Returns:
rms: float
The fractional rms amplitude contained between min_freq and
max_freq.
rms_err: float
The error on the fractional rms amplitude.
Other Parameters:
poisson_noise_levelfloat, default is None
This is the Poisson noise level of the PDS with same
normalization as the PDS. If poissoin_noise_level is None,
the Poisson noise is calculated in the idealcase
e.g. 2./<countrate> for fractional rms normalisation
Dead time and other instrumental effects can alter it.
The user can fit the Poisson noise level outside
this function using the same normalisation of the PDS
and it will get subtracted from powers here.
Clean up the list of attributes, only giving out those pointing to data.
List all the attributes that point directly to valid data. This method goes through all the
attributes of the class, eliminating methods, properties, and attributes that are complicated
to serialize such as other StingrayObject, or arrays of objects.
This function does not make difference between array-like data and scalar data.
Returns:
data_attributeslist of str
List of attributes pointing to data that are not methods, properties,
or other StingrayObject instances.
Create a Stingray Object object from data in an Astropy Table.
The table MUST contain at least a column named like the
main_array_attr.
The rest of columns will form the array attributes of the
new object, while the attributes in ds.attrs will
form the new meta attributes of the object.
Calculate an average power spectrum from an event list.
Parameters:
eventsstingray.EventList
Event list to be analyzed.
dtfloat
The time resolution of the intermediate light curves
(sets the Nyquist frequency).
Other Parameters:
segment_sizefloat
The length, in seconds, of the light curve segments that will be
averaged. Only relevant (and required) for
AveragedPowerspectrum.
gti: ``[[gti0_0, gti0_1], [gti1_0, gti1_1], …]``
Additional, optional Good Time intervals that get intersected with
the GTIs of the input object. Can cause errors if there are
overlaps between these GTIs and the input object GTIs. If that
happens, assign the desired GTIs to the input object.
normstr, default “frac”
The normalization of the periodogram. abs is absolute rms, frac
is fractional rms, leahy is Leahy+83 normalization, and none is
the unnormalized periodogram.
use_common_meanbool, default True
The mean of the light curve can be estimated in each interval, or
on the full light curve. This gives different results
(Alston+2013). By default, we assume the mean is calculated on the
full light curve, but the user can set use_common_mean to False
to calculate it on a per-segment basis.
silentbool, default False
Silence the progress bars.
save_allbool, default False
Save all intermediate PDSs used for the final average.
The time resolution of the light curves
(sets the Nyquist frequency)
Other Parameters:
segment_sizefloat
The length, in seconds, of the light curve segments that will be
averaged. Only relevant (and required) for
AveragedPowerspectrum.
gti: ``[[gti0_0, gti0_1], [gti1_0, gti1_1], …]``
Additional, optional Good Time intervals that get intersected with
the GTIs of the input object. Can cause errors if there are
overlaps between these GTIs and the input object GTIs. If that
happens, assign the desired GTIs to the input object.
normstr, default “frac”
The normalization of the periodogram. abs is absolute rms, frac
is fractional rms, leahy is Leahy+83 normalization, and none is
the unnormalized periodogram.
use_common_meanbool, default True
The mean of the light curve can be estimated in each interval, or
on the full light curve. This gives different results
(Alston+2013). By default, we assume the mean is calculated on the
full light curve, but the user can set use_common_mean to False
to calculate it on a per-segment basis.
silentbool, default False
Silence the progress bars.
save_allbool, default False
Save all intermediate PDSs used for the final average.
The time resolution of the intermediate light curves
(sets the Nyquist frequency).
Other Parameters:
segment_sizefloat
The length, in seconds, of the light curve segments that will be
averaged. Only relevant (and required) for
AveragedPowerspectrum.
gti: ``[[gti0_0, gti0_1], [gti1_0, gti1_1], …]``
Additional, optional Good Time intervals that get intersected with
the GTIs of the input object. Can cause errors if there are
overlaps between these GTIs and the input object GTIs. If that
happens, assign the desired GTIs to the input object.
normstr, default “frac”
The normalization of the periodogram. abs is absolute rms, frac
is fractional rms, leahy is Leahy+83 normalization, and none is
the unnormalized periodogram.
use_common_meanbool, default True
The mean of the light curve can be estimated in each interval, or
on the full light curve. This gives different results
(Alston+2013). By default, we assume the mean is calculated on the
full light curve, but the user can set use_common_mean to False
to calculate it on a per-segment basis.
silentbool, default False
Silence the progress bars.
save_allbool, default False
Save all intermediate PDSs used for the final average.
Create an StingrayObject object from data in a pandas DataFrame.
The dataframe MUST contain at least a column named like the
main_array_attr.
The rest of columns will form the array attributes of the
new object, while the attributes in ds.attrs will
form the new meta attributes of the object.
Since pandas does not support n-D data, multi-dimensional arrays can be
specified as <colname>_dimN_M_K etc.
See documentation of make_1d_arrays_into_nd for details.
What attribute of the time series will be used as error bar.
segment_sizefloat
The length, in seconds, of the light curve segments that will be averaged.
Only relevant (and required) for AveragedCrossspectrum
normstr, default “frac”
The normalization of the periodogram. “abs” is absolute rms, “frac” is
fractional rms, “leahy” is Leahy+83 normalization, and “none” is the
unnormalized periodogram
use_common_meanbool, default True
The mean of the light curve can be estimated in each interval, or on
the full light curve. This gives different results (Alston+2013).
Here we assume the mean is calculated on the full light curve, but
the user can set use_common_mean to False to calculate it on a
per-segment basis.
silentbool, default False
Silence the progress bars
gti: [[gti0_0, gti0_1], [gti1_0, gti1_1], …]
Good Time intervals. Defaults to the common GTIs from the two input
objects. Could throw errors if these GTIs have overlaps with the
input object GTIs! If you’re getting errors regarding your GTIs,
don’t use this and only give GTIs to the input objects before
making the cross spectrum.
save_allbool, default False
Save all intermediate PDSs used for the final average.
Calculate an average power spectrum from an array of event times.
Parameters:
timesnp.array
Event arrival times.
dtfloat
The time resolution of the intermediate light curves
(sets the Nyquist frequency).
Other Parameters:
segment_sizefloat
The length, in seconds, of the light curve segments that will be
averaged. Only relevant (and required) for
AveragedPowerspectrum.
gti: ``[[gti0_0, gti0_1], [gti1_0, gti1_1], …]``
Additional, optional Good Time intervals that get intersected with
the GTIs of the input object. Can cause errors if there are
overlaps between these GTIs and the input object GTIs. If that
happens, assign the desired GTIs to the input object.
normstr, default “frac”
The normalization of the periodogram. abs is absolute rms, frac
is fractional rms, leahy is Leahy+83 normalization, and none is
the unnormalized periodogram.
use_common_meanbool, default True
The mean of the light curve can be estimated in each interval, or
on the full light curve. This gives different results
(Alston+2013). By default, we assume the mean is calculated on the
full light curve, but the user can set use_common_mean to False
to calculate it on a per-segment basis.
The dataset MUST contain at least a column named like the
main_array_attr.
The rest of columns will form the array attributes of the
new object, while the attributes in ds.attrs will
form the new meta attributes of the object.
If AveragedCrossspectrum, you need segment_size
>>> AveragedCrossspectrum.initial_checks(ac, data1=ev1, data2=ev2, dt=1)
Traceback (most recent call last):
…
ValueError: segment_size must be specified…
And it needs to be finite!
>>> AveragedCrossspectrum.initial_checks(ac, data1=ev1, data2=ev2, dt=1., segment_size=np.nan)
Traceback (most recent call last):
…
ValueError: segment_size must be finite!
List the names of the internal array attributes of the Stingray Object.
These are array attributes that can be set by properties, and are generally indicated
by an underscore followed by the name of the property that links to it (E.g.
_counts in Lightcurve).
By array attributes, we mean the ones with the same size and shape as
main_array_attr (e.g. time in EventList)
The formula used to calculate the upper limit assumes the Leahy
normalization.
If the periodogram is in another normalization, we will internally
convert it to Leahy before calculating the upper limit.
Parameters:
fmin: float
The minimum frequency to search (defaults to the first nonzero bin)
fmax: float
The maximum frequency to search (defaults to the Nyquist frequency)
Returns:
a: float
The modulation amplitude that could produce P>pmeas with 1 - c
probability.
Other Parameters:
c: float
The confidence value for the upper limit (e.g. 0.95 = 95%)
Examples
>>> pds=Powerspectrum()>>> pds.norm="leahy">>> pds.freq=np.arange(0.,5.)>>> # Note: this pds has 40 as maximum value between 2 and 5 Hz>>> pds.power=np.array([100000,1,1,40,1])>>> pds.m=1>>> pds.nphots=30000>>> assertnp.isclose(... pds.modulation_upper_limit(fmin=2,fmax=5,c=0.99),... 0.10164,... atol=0.0001)
Plot the amplitude of the cross spectrum vs. the frequency using matplotlib.
Parameters:
labelsiterable, default None
A list of tuple with xlabel and ylabel as strings.
axislist, tuple, string, default None
Parameter to set axis properties of the matplotlib figure. For example
it can be a list like [xmin,xmax,ymin,ymax] or any other
acceptable argument for the``matplotlib.pyplot.axis()`` method.
titlestr, default None
The title of the plot.
markerstr, default ‘-’
Line style and color of the plot. Line styles and colors are
combined in a single format string, as in 'bo' for blue
circles. See matplotlib.pyplot.plot for more options.
saveboolean, optional, default False
If True, save the figure with specified filename.
filenamestr
File name of the image to save. Depends on the boolean save.
axmatplotlib.Axes object
An axes object to fill with the cross correlation plot.
Return a pretty-printed string representation of the object.
This is useful for debugging, and for interactive use.
Other Parameters:
func_to_applyfunction
A function that modifies the attributes listed in attrs_to_apply.
It must return the modified attributes and a label to be printed.
If None, no function is applied.
any other formats compatible with the writers in
astropy.table.Table (ascii.ecsv, hdf5, etc.)
Files that need the astropy.table.Table interface MUST contain
at least a column named like the main_array_attr.
The default ascii format is enhanced CSV (ECSV). Data formats
supporting the serialization of metadata (such as ECSV and HDF5) can
contain all attributes such as mission, gti, etc with
no significant loss of information. Other file formats might lose part
of the metadata, so must be used with care.
..note:
Complex values can be dealt with out-of-the-box in some formats
like HDF5 or FITS, not in others (e.g. all ASCII formats).
With these formats, and in any case when fmt is ``None``, complex
values should be stored as two columns of real numbers, whose names
are of the format <variablename>.real and <variablename>.imag
Parameters:
filename: str
Path and file name for the file to be read.
fmt: str
Available options are ‘pickle’, ‘hea’, and any Table-supported
format such as ‘hdf5’, ‘ascii.ecsv’, etc.
Logarithmic rebin of the periodogram.
The new frequency depends on the previous frequency
modified by a factor f:
\[d\nu_j = d\nu_{j-1} (1+f)\]
Parameters:
f: float, optional, default ``0.01``
parameter that steers the frequency resolution
Returns:
new_specCrossspectrum (or one of its subclasses) object
The newly binned cross spectrum or power spectrum.
Note: this object will be of the same type as the object
that called this method. For example, if this method is called
from AveragedPowerspectrum, it will return an object of class
Array attributes to be operated on. Defaults to all array attributes not ending in
_err.
The other array attributes will be discarded from the time series to avoid
inconsistencies.
error_attrslist of str or None
Array attributes to be operated on with error_operation. Defaults to all array
attributes ending with _err.
error_operationfunction
Function to be called to propagate the errors
inplacebool
If True, overwrite the current time series. Otherwise, return a new one.
Array attributes (e.g. time, pi, energy, etc. for
EventList) are converted into columns, while meta attributes
(mjdref, gti, etc.) are saved into the meta dictionary.
Other Parameters:
no_longdoublebool
If True, reduce the precision of longdouble arrays to double precision.
This needs to be done in some cases, e.g. when the table is to be saved
in an architecture not supporting extended precision (e.g. ARM), but can
also be useful when an extended precision is not needed.
Array attributes (e.g. time, pi, energy, etc. for
EventList) are converted into columns, while meta attributes
(mjdref, gti, etc.) are saved into the ds.attrs dictionary.
Since pandas does not support n-D data, multi-dimensional arrays are
converted into columns before the conversion, with names <colname>_dimN_M_K etc.
See documentation of make_nd_into_arrays for details.
Array attributes (e.g. time, pi, energy, etc. for
EventList) are converted into columns, while meta attributes
(mjdref, gti, etc.) are saved into the ds.attrs dictionary.
Make an averaged periodogram from a light curve by segmenting the light
curve, Fourier-transforming each segment and then averaging the
resulting periodograms.
Parameters:
data: :class:`stingray.Lightcurve`object OR iterable of :class:`stingray.Lightcurve` objects OR :class:`stingray.EventList` object
The light curve data to be Fourier-transformed.
segment_size: float
The size of each segment to average. Note that if the total
duration of each Lightcurve object in lc is not an integer
multiple of the segment_size, then any fraction left-over at the
end of the time series will be lost.
[[gti0_0,gti0_1],[gti1_0,gti1_1],...] – Good Time intervals.
This choice overrides the GTIs in the single light curves. Use with
care, especially if these GTIs have overlaps with the input
object GTIs! If you’re getting errors regarding your GTIs, don’t
use this and only give GTIs to the input object before making
the power spectrum.
silentbool, default False
Do not show a progress bar when generating an averaged cross spectrum.
Useful for the batch execution of many spectra.
dt: float
The time resolution of the light curve. Only needed when constructing
light curves in the case where data is of :class:EventList.
save_allbool, default False
Save all intermediate PDSs used for the final average. Use with care.
This is likely to fill up your RAM on medium-sized datasets, and to
slow down the computation when rebinning.
skip_checks: bool
Skip initial checks, for speed or other reasons (you need to trust your
inputs!).
The array of mid-bin frequencies that the Fourier transform samples.
power: numpy.ndarray
The array of normalized powers
power_err: numpy.ndarray
The uncertainties of power.
An approximation for each bin given by power_err=power/sqrt(m).
Where m is the number of power averaged in each bin (by frequency
binning, or averaging power spectra of segments of a light curve).
Note that for a single realization (m=1) the error is equal to the
power.
unnorm_power: numpy.ndarray
The array of unnormalized powers
unnorm_power_err: numpy.ndarray
The uncertainties of unnorm_power.
df: float
The frequency resolution.
m: int
The number of averaged periodograms.
n: int
The number of data points in the light curve.
nphots: float
The total number of photons in the light curve.
cs_all: list of :class:`Powerspectrum` objects
The list of all periodograms used to calculate the average periodogram.
any other formats compatible with the writers in
astropy.table.Table (ascii.ecsv, hdf5, etc.)
..note:
Complex values can be dealt with out-of-the-box in some formats
like HDF5 or FITS, not in others (e.g. all ASCII formats).
With these formats, and in any case when fmt is ``None``, complex
values will be stored as two columns of real numbers, whose names
are of the format <variablename>.real and <variablename>.imag
Parameters:
filename: str
Name and path of the file to save the object list to.
fmt: str
The file format to store the data in.
Available options are pickle, hdf5, ascii, fits
Array attributes to be operated on. Defaults to all array attributes not ending in
_err.
The other array attributes will be discarded from the time series to avoid
inconsistencies.
error_attrslist of str or None
Array attributes to be operated on with error_operation. Defaults to all array
attributes ending with _err.
error_operationfunction
Function to be called to propagate the errors
inplacebool
If True, overwrite the current time series. Otherwise, return a new one.
Apply a mask to all array attributes of the object
Parameters:
maskarray of bool
The mask. Has to be of the same length as self.time
Returns:
ts_newStingrayObject object
The new object with the mask applied if inplace is False, otherwise the
same object.
Other Parameters:
inplacebool
If True, overwrite the current object. Otherwise, return a new one.
filtered_attrslist of str or None
Array attributes to be filtered. Defaults to all array attributes if None.
The other array attributes will be set to None. The main array attr is always
included.
Compute the classical significances for the powers in the power
spectrum, assuming an underlying noise distribution that follows a
chi-square distributions with 2M degrees of freedom, where M is the
number of powers averaged in each bin.
Note that this function will only produce correct results when the
following underlying assumptions are fulfilled:
The power spectrum is Leahy-normalized
There is no source of variability in the data other than the
periodic signal to be determined with this method. This is important!
If there are other sources of (aperiodic) variability in the data, this
method will not produce correct results, but instead produce a large
number of spurious false positive detections!
There are no significant instrumental effects changing the
statistical distribution of the powers (e.g. pile-up or dead time)
By default, the method produces (index,p-values) for all powers in
the power spectrum, where index is the numerical index of the power in
question. If a threshold is set, then only powers with p-values
below that threshold with their respective indices. If
trial_correction is set to True, then the threshold will be corrected
for the number of trials (frequencies) in the power spectrum before
being used.
Parameters:
thresholdfloat, optional, default 1
The threshold to be used when reporting p-values of potentially
significant powers. Must be between 0 and 1.
Default is 1 (all p-values will be reported).
trial_correctionbool, optional, default False
A Boolean flag that sets whether the threshold will be corrected
by the number of frequencies before being applied. This decreases
the threshold (p-values need to be lower to count as significant).
Default is False (report all powers) though for any application
where threshold` is set to something meaningful, this should also
be applied!
Returns:
pvalsiterable
A list of (index,p-value) tuples for all powers that have p-values
lower than the threshold specified in threshold.
Coherence is defined in Vaughan and Nowak, 1996 [6].
It is a Fourier frequency dependent measure of the linear correlation
between time series measured simultaneously in two energy channels.
Compute an averaged Coherence function of cross spectrum by computing
coherence function of each segment and averaging them. The return type
is a tuple with first element as the coherence function and the second
element as the corresponding uncertainty associated with it.
Note : The uncertainty in coherence function is strictly valid for Gaussian statistics only.
Returns:
(coh, uncertainty)tuple of np.ndarray
Tuple comprising the coherence function and uncertainty.
Clean up the list of attributes, only giving out those pointing to data.
List all the attributes that point directly to valid data. This method goes through all the
attributes of the class, eliminating methods, properties, and attributes that are complicated
to serialize such as other StingrayObject, or arrays of objects.
This function does not make difference between array-like data and scalar data.
Returns:
data_attributeslist of str
List of attributes pointing to data that are not methods, properties,
or other StingrayObject instances.
Create a Stingray Object object from data in an Astropy Table.
The table MUST contain at least a column named like the
main_array_attr.
The rest of columns will form the array attributes of the
new object, while the attributes in ds.attrs will
form the new meta attributes of the object.
Calculate AveragedCrossspectrum from two event lists
Parameters:
events1stingray.EventList
Events from channel 1
events2stingray.EventList
Events from channel 2
dtfloat
The time resolution of the intermediate light curves
(sets the Nyquist frequency)
Other Parameters:
segment_sizefloat
The length, in seconds, of the light curve segments that will be averaged.
Only relevant (and required) for AveragedCrossspectrum
normstr, default “frac”
The normalization of the periodogram. “abs” is absolute rms, “frac” is
fractional rms, “leahy” is Leahy+83 normalization, and “none” is the
unnormalized periodogram
use_common_meanbool, default True
The mean of the light curve can be estimated in each interval, or on
the full light curve. This gives different results (Alston+2013).
Here we assume the mean is calculated on the full light curve, but
the user can set use_common_mean to False to calculate it on a
per-segment basis.
fullspecbool, default False
Return the full periodogram, including negative frequencies
silentbool, default False
Silence the progress bars
power_typestr, default ‘all’
If ‘all’, give complex powers. If ‘abs’, the absolute value; if ‘real’,
the real part
gti: [[gti0_0, gti0_1], [gti1_0, gti1_1], …]
Good Time intervals. Defaults to the common GTIs from the two input
objects. Could throw errors if these GTIs have overlaps with the
input object GTIs! If you’re getting errors regarding your GTIs,
don’t use this and only give GTIs to the input objects before
making the cross spectrum.
Light curves from channel 2. If arrays, use them as counts
dtfloat
The time resolution of the light curves
(sets the Nyquist frequency)
Other Parameters:
segment_sizefloat
The length, in seconds, of the light curve segments that will be averaged.
Only relevant (and required) for AveragedCrossspectrum
normstr, default “frac”
The normalization of the periodogram. “abs” is absolute rms, “frac” is
fractional rms, “leahy” is Leahy+83 normalization, and “none” is the
unnormalized periodogram
use_common_meanbool, default True
The mean of the light curve can be estimated in each interval, or on
the full light curve. This gives different results (Alston+2013).
Here we assume the mean is calculated on the full light curve, but
the user can set use_common_mean to False to calculate it on a
per-segment basis.
fullspecbool, default False
Return the full periodogram, including negative frequencies
silentbool, default False
Silence the progress bars
power_typestr, default ‘all’
If ‘all’, give complex powers. If ‘abs’, the absolute value; if ‘real’,
the real part
gti: [[gti0_0, gti0_1], [gti1_0, gti1_1], …]
Good Time intervals. Defaults to the common GTIs from the two input
objects. Could throw errors if these GTIs have overlaps with the
input object GTIs! If you’re getting errors regarding your GTIs,
don’t use this and only give GTIs to the input objects before
making the cross spectrum.
save_allbool, default False
If True, save the cross spectrum of each segment in the cs_all
attribute of the output Crossspectrum object.
The length, in seconds, of the light curve segments that will be averaged.
Only relevant (and required) for AveragedCrossspectrum
normstr, default “frac”
The normalization of the periodogram. “abs” is absolute rms, “frac” is
fractional rms, “leahy” is Leahy+83 normalization, and “none” is the
unnormalized periodogram
use_common_meanbool, default True
The mean of the light curve can be estimated in each interval, or on
the full light curve. This gives different results (Alston+2013).
Here we assume the mean is calculated on the full light curve, but
the user can set use_common_mean to False to calculate it on a
per-segment basis.
fullspecbool, default False
Return the full periodogram, including negative frequencies
silentbool, default False
Silence the progress bars
power_typestr, default ‘all’
If ‘all’, give complex powers. If ‘abs’, the absolute value; if ‘real’,
the real part
gti: [[gti0_0, gti0_1], [gti1_0, gti1_1], …]
Good Time intervals. Defaults to the common GTIs from the two input
objects. Could throw errors if these GTIs have overlaps with the
input object GTIs! If you’re getting errors regarding your GTIs,
don’t use this and only give GTIs to the input objects before
making the cross spectrum.
Create an StingrayObject object from data in a pandas DataFrame.
The dataframe MUST contain at least a column named like the
main_array_attr.
The rest of columns will form the array attributes of the
new object, while the attributes in ds.attrs will
form the new meta attributes of the object.
Since pandas does not support n-D data, multi-dimensional arrays can be
specified as <colname>_dimN_M_K etc.
See documentation of make_1d_arrays_into_nd for details.
What attribute of the time series will be used as error bar.
segment_sizefloat
The length, in seconds, of the light curve segments that will be averaged.
Only relevant (and required) for AveragedCrossspectrum
normstr, default “frac”
The normalization of the periodogram. “abs” is absolute rms, “frac” is
fractional rms, “leahy” is Leahy+83 normalization, and “none” is the
unnormalized periodogram
use_common_meanbool, default True
The mean of the light curve can be estimated in each interval, or on
the full light curve. This gives different results (Alston+2013).
Here we assume the mean is calculated on the full light curve, but
the user can set use_common_mean to False to calculate it on a
per-segment basis.
fullspecbool, default False
Return the full periodogram, including negative frequencies
silentbool, default False
Silence the progress bars
power_typestr, default ‘all’
If ‘all’, give complex powers. If ‘abs’, the absolute value; if ‘real’,
the real part
gti: [[gti0_0, gti0_1], [gti1_0, gti1_1], …]
Good Time intervals. Defaults to the common GTIs from the two input
objects. Could throw errors if these GTIs have overlaps with the
input object GTIs! If you’re getting errors regarding your GTIs,
don’t use this and only give GTIs to the input objects before
making the cross spectrum.
Calculate AveragedCrossspectrum from two arrays of event times.
Parameters:
times1np.array
Event arrival times of channel 1
times2np.array
Event arrival times of channel 2
dtfloat
The time resolution of the intermediate light curves
(sets the Nyquist frequency)
Other Parameters:
segment_sizefloat
The length, in seconds, of the light curve segments that will be
averaged. Only relevant (and required) for AveragedCrossspectrum.
gti[[gti0, gti1], …]
Good Time intervals. Defaults to the common GTIs from the two input
objects. Could throw errors if these GTIs have overlaps with the
input object GTIs! If you’re getting errors regarding your GTIs,
don’t use this and only give GTIs to the input objects before
making the cross spectrum.
normstr, default “frac”
The normalization of the periodogram. “abs” is absolute rms, “frac” is
fractional rms, “leahy” is Leahy+83 normalization, and “none” is the
unnormalized periodogram
use_common_meanbool, default True
The mean of the light curve can be estimated in each interval, or on
the full light curve. This gives different results (Alston+2013).
Here we assume the mean is calculated on the full light curve, but
the user can set use_common_mean to False to calculate it on a
per-segment basis.
fullspecbool, default False
Return the full periodogram, including negative frequencies
silentbool, default False
Silence the progress bars
power_typestr, default ‘all’
If ‘all’, give complex powers. If ‘abs’, the absolute value; if ‘real’,
the real part
The dataset MUST contain at least a column named like the
main_array_attr.
The rest of columns will form the array attributes of the
new object, while the attributes in ds.attrs will
form the new meta attributes of the object.
If AveragedCrossspectrum, you need segment_size
>>> AveragedCrossspectrum.initial_checks(ac, data1=ev1, data2=ev2, dt=1)
Traceback (most recent call last):
…
ValueError: segment_size must be specified…
And it needs to be finite!
>>> AveragedCrossspectrum.initial_checks(ac, data1=ev1, data2=ev2, dt=1., segment_size=np.nan)
Traceback (most recent call last):
…
ValueError: segment_size must be finite!
List the names of the internal array attributes of the Stingray Object.
These are array attributes that can be set by properties, and are generally indicated
by an underscore followed by the name of the property that links to it (E.g.
_counts in Lightcurve).
By array attributes, we mean the ones with the same size and shape as
main_array_attr (e.g. time in EventList)
Plot the amplitude of the cross spectrum vs. the frequency using matplotlib.
Parameters:
labelsiterable, default None
A list of tuple with xlabel and ylabel as strings.
axislist, tuple, string, default None
Parameter to set axis properties of the matplotlib figure. For example
it can be a list like [xmin,xmax,ymin,ymax] or any other
acceptable argument for the``matplotlib.pyplot.axis()`` method.
titlestr, default None
The title of the plot.
markerstr, default ‘-’
Line style and color of the plot. Line styles and colors are
combined in a single format string, as in 'bo' for blue
circles. See matplotlib.pyplot.plot for more options.
saveboolean, optional, default False
If True, save the figure with specified filename.
filenamestr
File name of the image to save. Depends on the boolean save.
axmatplotlib.Axes object
An axes object to fill with the cross correlation plot.
Return the power colors of the dynamical power spectrum.
Parameters:
freq_edges: iterable
The edges of the frequency bins to be used for the power colors.
freqs_to_exclude1-d or 2-d iterable, optional, default None
The ranges of frequencies to exclude from the calculation of the power color.
For example, the frequencies containing strong QPOs.
A 1-d iterable should contain two values for the edges of a single range. (E.g.
[0.1,0.2]). [[0.1,0.2],[3,4]] will exclude the ranges 0.1-0.2 Hz and
3-4 Hz.
poisson_levelfloat or iterable, optional
Defaults to the theoretical Poisson noise level (e.g. 2 for Leahy normalization).
The Poisson noise level of the power spectrum. If iterable, it should have the same
length as frequency. (This might apply to the case of a power spectrum with a
strong dead time distortion)
Returns:
pc0: np.ndarray
pc0_err: np.ndarray
pc1: np.ndarray
pc1_err: np.ndarray
The power colors for each spectrum and their respective errors
Return a pretty-printed string representation of the object.
This is useful for debugging, and for interactive use.
Other Parameters:
func_to_applyfunction
A function that modifies the attributes listed in attrs_to_apply.
It must return the modified attributes and a label to be printed.
If None, no function is applied.
any other formats compatible with the writers in
astropy.table.Table (ascii.ecsv, hdf5, etc.)
Files that need the astropy.table.Table interface MUST contain
at least a column named like the main_array_attr.
The default ascii format is enhanced CSV (ECSV). Data formats
supporting the serialization of metadata (such as ECSV and HDF5) can
contain all attributes such as mission, gti, etc with
no significant loss of information. Other file formats might lose part
of the metadata, so must be used with care.
..note:
Complex values can be dealt with out-of-the-box in some formats
like HDF5 or FITS, not in others (e.g. all ASCII formats).
With these formats, and in any case when fmt is ``None``, complex
values should be stored as two columns of real numbers, whose names
are of the format <variablename>.real and <variablename>.imag
Parameters:
filename: str
Path and file name for the file to be read.
fmt: str
Available options are ‘pickle’, ‘hea’, and any Table-supported
format such as ‘hdf5’, ‘ascii.ecsv’, etc.
Rebin the cross spectrum to a new frequency resolution df.
Parameters:
df: float
The new frequency resolution
Returns:
bin_cs = Crossspectrum (or one of its subclasses) object
The newly binned cross spectrum or power spectrum.
Note: this object will be of the same type as the object
that called this method. For example, if this method is called
from AveragedPowerspectrum, it will return an object of class
AveragedPowerspectrum, too.
Other Parameters:
f: float
the rebin factor. If specified, it substitutes df with f*self.df
Rebin the Dynamic Power Spectrum to a new time resolution, by summing contiguous intervals.
This is different from meth:DynamicalPowerspectrum.rebin_time in that it averages n
consecutive intervals regardless of their distance in time. rebin_time will instead
average intervals that are separated at most by a time dt_new.
Rebin the Dynamic Power Spectrum to a new frequency resolution.
Rebinning is an in-place operation, i.e. will replace the existing
dyn_ps attribute.
While the new resolution does not need to be an integer of the previous frequency
resolution, be aware that if this is the case, the last frequency bin will be cut
off by the fraction left over by the integer division
Parameters:
df_new: float
The new frequency resolution of the dynamical power spectrum.
Must be larger than the frequency resolution of the old dynamical
power spectrum!
Logarithmic rebin of the periodogram.
The new frequency depends on the previous frequency
modified by a factor f:
\[d\nu_j = d\nu_{j-1} (1+f)\]
Parameters:
f: float, optional, default ``0.01``
parameter that steers the frequency resolution
Returns:
new_specCrossspectrum (or one of its subclasses) object
The newly binned cross spectrum or power spectrum.
Note: this object will be of the same type as the object
that called this method. For example, if this method is called
from AveragedPowerspectrum, it will return an object of class
Rebin the Dynamic Power Spectrum to a new time resolution.
Note: this is not changing the time resolution of the input light
curve! dt is the integration time of each line of the dynamical power
spectrum (typically, an integer multiple of segment_size).
While the new resolution does not need to be an integer of the previous time
resolution, be aware that if this is the case, the last time bin will be cut
off by the fraction left over by the integer division
Parameters:
dt_new: float
The new time resolution of the dynamical power spectrum.
Must be larger than the time resolution of the old dynamical power
spectrum!
Array attributes to be operated on. Defaults to all array attributes not ending in
_err.
The other array attributes will be discarded from the time series to avoid
inconsistencies.
error_attrslist of str or None
Array attributes to be operated on with error_operation. Defaults to all array
attributes ending with _err.
error_operationfunction
Function to be called to propagate the errors
inplacebool
If True, overwrite the current time series. Otherwise, return a new one.
Array attributes (e.g. time, pi, energy, etc. for
EventList) are converted into columns, while meta attributes
(mjdref, gti, etc.) are saved into the meta dictionary.
Other Parameters:
no_longdoublebool
If True, reduce the precision of longdouble arrays to double precision.
This needs to be done in some cases, e.g. when the table is to be saved
in an architecture not supporting extended precision (e.g. ARM), but can
also be useful when an extended precision is not needed.
Array attributes (e.g. time, pi, energy, etc. for
EventList) are converted into columns, while meta attributes
(mjdref, gti, etc.) are saved into the ds.attrs dictionary.
Since pandas does not support n-D data, multi-dimensional arrays are
converted into columns before the conversion, with names <colname>_dimN_M_K etc.
See documentation of make_nd_into_arrays for details.
Array attributes (e.g. time, pi, energy, etc. for
EventList) are converted into columns, while meta attributes
(mjdref, gti, etc.) are saved into the ds.attrs dictionary.
Create a dynamical power spectrum, also often called a spectrogram.
This class will divide a Lightcurve object into segments of
length segment_size, create a power spectrum for each segment and store
all powers in a matrix as a function of both time (using the mid-point of
each segment) and frequency.
This is often used to trace changes in period of a (quasi-)periodic signal
over time.
[[gti0_0,gti0_1],[gti1_0,gti1_1],...] – Good Time intervals.
This choice overrides the GTIs in the single light curves. Use with
care, especially if these GTIs have overlaps with the input
object GTIs! If you’re getting errors regarding your GTIs, don’t
use this and only give GTIs to the input object before making
the power spectrum.
sample_time: float
Compulsory for input stingray.EventList data. The time resolution of the
lightcurve that is created internally from the input event lists. Drives the
Nyquist frequency.
Attributes:
segment_size: float
The size of each segment to average. Note that if the total
duration of each input object in lc is not an integer multiple
of the segment_size, then any fraction left-over at the end of the
time series will be lost.
dyn_psnp.ndarray
The matrix of normalized squared absolute values of Fourier
amplitudes. The axis are given by the freq
and time attributes.
norm: {``leahy`` | ``frac`` | ``abs`` | ``none``}
The normalization of the periodogram.
freq: numpy.ndarray
The array of mid-bin frequencies that the Fourier transform samples.
time: numpy.ndarray
The array of mid-point times of each interval used for the dynamical
power spectrum.
df: float
The frequency resolution.
dt: float
The time resolution of the dynamical spectrum. It is not the time resolution of the
input light curve. It is the integration time of each line of the dynamical power
spectrum (typically, an integer multiple of segment_size).
any other formats compatible with the writers in
astropy.table.Table (ascii.ecsv, hdf5, etc.)
..note:
Complex values can be dealt with out-of-the-box in some formats
like HDF5 or FITS, not in others (e.g. all ASCII formats).
With these formats, and in any case when fmt is ``None``, complex
values will be stored as two columns of real numbers, whose names
are of the format <variablename>.real and <variablename>.imag
Parameters:
filename: str
Name and path of the file to save the object list to.
fmt: str
The file format to store the data in.
Available options are pickle, hdf5, ascii, fits
A string indicating the size of the correlation output.
See the relevant scipy documentation [scipy-docs]
for more details.
norm: {``none``, ``variance``}
if “variance”, the cross correlation is normalized so that perfect
correlation gives 1, and perfect anticorrelation gives -1. See
Gaskell & Peterson 1987, Gardner & Done 2017
The first light curve data for correlation calculations.
lc2: :class:`stingray.Lightcurve`
The light curve data for the correlation calculations.
cross: :class: `stingray.Crossspectrum`
The cross spectrum data for the correlation calculations.
corr: numpy.ndarray
An array of correlation data calculated from two light curves
time_lags: numpy.ndarray
An array of all possible time lags against which each point in corr is calculated
dt: float
The time resolution of each light curve (used in time_lag calculations)
time_shift: float
Time lag that gives maximum value of correlation between two light curves.
There will be maximum correlation between light curves if one of the light curve
is shifted by time_shift.
n: int
Number of points in self.corr (length of cross-correlation data)
auto: bool
An internal flag to indicate whether this is a cross-correlation or an auto-correlation.
Calculate the cross correlation against all possible time lags, both positive and negative.
The method signal.correlation_lags() uses SciPy versions >= 1.6.1 ([scipy-docs-lag])
Parameters:
dt: float, optional, default ``1.0``
Time resolution of the light curve, should be passed when object is populated with
correlation data and no information about light curve can be extracted. Used to
calculate time_lags.
Returns:
self.time_shift: float
Value of the time lag that gives maximum value of correlation between two light curves.
self.time_lags: numpy.ndarray
An array of time_lags calculated from correlation data
Plot the Crosscorrelation as function using Matplotlib.
Plot the Crosscorrelation object on a graph self.time_lags on x-axis and
self.corr on y-axis
Parameters:
labelsiterable, default None
A list of tuple with xlabel and ylabel as strings.
axislist, tuple, string, default None
Parameter to set axis properties of matplotlib figure. For example
it can be a list like [xmin,xmax,ymin,ymax] or any other
acceptable argument for matplotlib.pyplot.axis() function.
titlestr, default None
The title of the plot.
markerstr, default -
Line style and color of the plot. Line styles and colors are
combined in a single format string, as in 'bo' for blue
circles. See matplotlib.pyplot.plot for more options.
saveboolean, optional (default=False)
If True, save the figure with specified filename.
filenamestr
File name of the image to save. Depends on the boolean save.
axmatplotlib.Axes object
An axes object to fill with the cross correlation plot.
Calculate the cross correlation against all possible time lags, both positive and negative.
The method signal.correlation_lags() uses SciPy versions >= 1.6.1 ([scipy-docs-lag])
Parameters:
dt: float, optional, default ``1.0``
Time resolution of the light curve, should be passed when object is populated with
correlation data and no information about light curve can be extracted. Used to
calculate time_lags.
Returns:
self.time_shift: float
Value of the time lag that gives maximum value of correlation between two light curves.
self.time_lags: numpy.ndarray
An array of time_lags calculated from correlation data
Plot the Crosscorrelation as function using Matplotlib.
Plot the Crosscorrelation object on a graph self.time_lags on x-axis and
self.corr on y-axis
Parameters:
labelsiterable, default None
A list of tuple with xlabel and ylabel as strings.
axislist, tuple, string, default None
Parameter to set axis properties of matplotlib figure. For example
it can be a list like [xmin,xmax,ymin,ymax] or any other
acceptable argument for matplotlib.pyplot.axis() function.
titlestr, default None
The title of the plot.
markerstr, default -
Line style and color of the plot. Line styles and colors are
combined in a single format string, as in 'bo' for blue
circles. See matplotlib.pyplot.plot for more options.
saveboolean, optional (default=False)
If True, save the figure with specified filename.
filenamestr
File name of the image to save. Depends on the boolean save.
axmatplotlib.Axes object
An axes object to fill with the cross correlation plot.
The two input light curve must be strictly simultaneous, and recorded by
two independent detectors with similar responses, so that the count rates
are similar and dead time is independent.
The method does not apply to different energy channels of the same
instrument, or to the signal observed by two instruments with very
different responses. See the paper for caveats.
Parameters:
data1Lightcurve or EventList
Input data for channel 1
data2Lightcurve or EventList
Input data for channel 2. Must be strictly simultaneous to data1
and, if a light curve, have the same binning time. Also, it must be
strictly independent, e.g. from a different detector. There must be
no dead time cross-talk between the two time series.
segment_size: float
The final Fourier products are averaged over many segments of the
input light curves. This is the length of each segment being averaged.
Note that the light curve must be long enough to have at least 30
segments, as the result gets better as one averages more and more
segments.
dtfloat
Time resolution of the light curves used to produce periodograms
The content of results depends on whether return_objects is
True or False.
If return_objects==False,
results is a Table with the following columns:
pds1: the corrected PDS of lc1
pds2: the corrected PDS of lc2
cs: the corrected cospectrum
ptot: the corrected PDS of lc1 + lc2
If return_objects is True, results is a dict, with keys
named like the columns
listed above but with AveragePowerspectrum or
AverageCrossspectrum objects instead of arrays.
Other Parameters:
plotbool, default False
Plot diagnostics: check if the smoothed Fourier difference scatter is
a good approximation of the data scatter.
axmatplotlib.axes.axes object
If not None and plot is True, use this axis object to produce
the diagnostic plot. Otherwise, create a new figure.
smoothing_alg{‘gauss’, …}
Smoothing algorithm. For now, the only smoothing algorithm allowed is
gauss, which applies a Gaussian Filter from scipy.
smoothing_lengthint, default segment_size*3
Number of bins to smooth in gaussian window smoothing
verbose: bool, default False
Print out information on the outcome of the algorithm (recommended)
tolerancefloat, default 0.05
Accepted relative error on the FAD-corrected Fourier amplitude, to be
used as success diagnostics.
Should be
`stdtheor=2/np.sqrt(n)std=(average_corrected_fourier_diff/n).std()np.abs((std-stdtheor)/stdtheor)<tolerance`
strictbool, default False
Decide what to do if the condition on tolerance is not met. If True,
raise a RuntimeError. If False, just throw a warning.
output_filestr, default None
Name of an output file (any extension automatically recognized by
Astropy is fine)
The two input light curve must be strictly simultaneous, and recorded by
two independent detectors with similar responses, so that the count rates
are similar and dead time is independent.
The method does not apply to different energy channels of the same
instrument, or to the signal observed by two instruments with very
different responses. See the paper for caveats.
Parameters:
lc1: class:`stingray.ligthtcurve.Lightcurve`
Light curve from channel 1
lc2: class:`stingray.ligthtcurve.Lightcurve`
Light curve from channel 2. Must be strictly simultaneous to lc1
and have the same binning time. Also, it must be strictly independent,
e.g. from a different detector. There must be no dead time cross-talk
between the two light curves.
segment_size: float
The final Fourier products are averaged over many segments of the
input light curves. This is the length of each segment being averaged.
Note that the light curve must be long enough to have at least 30
segments, as the result gets better as one averages more and more
segments.
The content of results depends on whether return_objects is
True or False.
If return_objects==False,
results is a Table with the following columns:
pds1: the corrected PDS of lc1
pds2: the corrected PDS of lc2
cs: the corrected cospectrum
ptot: the corrected PDS of lc1 + lc2
If return_objects is True, results is a dict, with keys
named like the columns
listed above but with AveragePowerspectrum or
AverageCrossspectrum objects instead of arrays.
Other Parameters:
plotbool, default False
Plot diagnostics: check if the smoothed Fourier difference scatter is
a good approximation of the data scatter.
axmatplotlib.axes.axes object
If not None and plot is True, use this axis object to produce
the diagnostic plot. Otherwise, create a new figure.
smoothing_alg{‘gauss’, …}
Smoothing algorithm. For now, the only smoothing algorithm allowed is
gauss, which applies a Gaussian Filter from scipy.
smoothing_lengthint, default segment_size*3
Number of bins to smooth in gaussian window smoothing
verbose: bool, default False
Print out information on the outcome of the algorithm (recommended)
tolerancefloat, default 0.05
Accepted relative error on the FAD-corrected Fourier amplitude, to be
used as success diagnostics.
Should be
`stdtheor=2/np.sqrt(n)std=(average_corrected_fourier_diff/n).std()np.abs((std-stdtheor)/stdtheor)<tolerance`
strictbool, default False
Decide what to do if the condition on tolerance is not met. If True,
raise a RuntimeError. If False, just throw a warning.
output_filestr, default None
Name of an output file (any extension automatically recognized by
Astropy is fine)
The factorial of non-negative integer n is the product of all
positive integers less than or equal to n:
n! = n * (n - 1) * (n - 2) * ... * 1
Parameters:
nint or array_like of ints
Input values. If n<0, the return value is 0.
exactbool, optional
If True, calculate the answer exactly using long integer arithmetic.
If False, result is approximated in floating point rapidly using the
gamma function.
Default is False.
Returns:
nffloat or int or ndarray
Factorial of n, as integer or float depending on exact.
Notes
For arrays with exact=True, the factorial is computed only once, for
the largest input, with each other result computed in the process.
The output dtype is increased to int64 or object if necessary.
With exact=False the factorial is approximated using the gamma
function:
Limit to this value the number of terms in the inner loops of
calculations. Check the plots returned by the check_B and
check_A functions to test that this number is adequate.
Term in Eq. 39 in Zhang+95, with a cut in the maximum k.
This can be risky. Only use if B is really 0 for high k.
Higher-Order Fourier and Spectral Timing Products¶
These classes implement higher-order Fourier analysis products (e.g. Bispectrum) and
Spectral Timing related methods taking advantage of both temporal and spectral information in
modern data sets.
Bispectrum is a higher order time series analysis method and is calculated by
indirect method as Fourier transform of triple auto-correlation function also called as
3rd order cumulant.
Maximum lag on both positive and negative sides of
3rd order cumulant (Similar to lags in correlation).
if None, max lag is set to one-half of length of light curve.
Flag to decide biased or unbiased normalization for 3rd order cumulant function.
References
1) The biphase explained: understanding the asymmetries invcoupled Fourier components of astronomical timeseries
by Thomas J. Maccarone Department of Physics, Box 41051, Science Building, Texas Tech University, Lubbock TX 79409-1051
School of Physics and Astronomy, University of Southampton, SO16 4ES
2) T. S. Rao, M. M. Gabr, An Introduction to Bispectral Analysis and Bilinear Time
Series Models, Lecture Notes in Statistics, Volume 24, D. Brillinger, S. Fienberg,
J. Gani, J. Hartigan, K. Krickeberg, Editors, Springer-Verlag, New York, NY, 1984.
Plot the 3rd order cumulant as function of time lags using matplotlib.
Plot the cum3 attribute on a graph with the lags attribute on x-axis and y-axis and
cum3 on z-axis
Parameters:
axislist, tuple, string, default None
Parameter to set axis properties of matplotlib figure. For example
it can be a list like [xmin,xmax,ymin,ymax] or any other
acceptable argument for matplotlib.pyplot.axis() method.
savebool, optionalm, default False
If True, save the figure with specified filename.
filenamestr
File name and path of the image to save. Depends on the boolean save.
Plot the magnitude of bispectrum as function of freq using matplotlib.
Plot the bispec_mag attribute on a graph with freq attribute on the x-axis and y-axis and
the bispec_mag attribute on the z-axis.
Parameters:
axislist, tuple, string, default None
Parameter to set axis properties of matplotlib figure. For example
it can be a list like [xmin,xmax,ymin,ymax] or any other
acceptable argument for matplotlib.pyplot.axis() method.
savebool, optional, default False
If True, save the figure with specified filename and path.
filenamestr
File name and path of the image to save. Depends on the bool save.
Plot the phase of bispectrum as function of freq using matplotlib.
Plot the bispec_phase attribute on a graph with phase attribute on the x-axis and
y-axis and the bispec_phase attribute on the z-axis.
Parameters:
axislist, tuple, string, default None
Parameter to set axis properties of matplotlib figure. For example
it can be a list like [xmin,xmax,ymin,ymax] or any other
acceptable argument for matplotlib.pyplot.axis() function.
savebool, optional, default False
If True, save the figure with specified filename and path.
filenamestr
File name and path of the image to save. Depends on the bool save.
Compute a covariance spectrum for the data. The input data can be
either in event data or pre-made light curves. Event data can either
be in the form of a numpy.ndarray with (timestamp,energy) pairs or
a stingray.events.EventList object. If light curves are formed ahead
of time, then a list of stingray.Lightcurve objects should be passed to the
object, ideally one light curve for each band of interest.
For the case where the data is input as a list of stingray.Lightcurve objects,
the reference band(s) should either be
a list of stingray.Lightcurve objects with the reference band for each band
of interest pre-made, or
None, in which case reference bands will
formed by combining all light curves except for the band of interest.
In the case of event data, band_interest and ref_band_interest can
be (multiple) pairs of energies, and the light curves for the bands of
interest and reference bands will be produced dynamically.
data contains the time series data, either in the form of a
2-D array of (timestamp,energy) pairs for event data, or as a
list of light curves.
Note : The event list must be in sorted order with respect to the
times of arrivals.
dtfloat
The time resolution of the stingray.Lightcurve formed from the energy bin.
Only used if data is an event list.
band_interest{None, iterable of tuples}
If None, all possible energy values will be assumed to be of
interest, and a covariance spectrum in the highest resolution
will be produced.
Note: if the input is a list of stingray.Lightcurve objects, then the user may
supply their energy values here, for construction of a
reference band.
Defines the reference band to be used for comparison with the
bands of interest. If None, all bands except the band of
interest will be used for each band of interest, respectively.
Alternatively, a tuple can be given for event list data, which will
extract the reference band (always excluding the band of interest),
or one may put in a single stingray.Lightcurve object to be used (the same
for each band of interest) or a list of stingray.Lightcurve objects, one for
each band of interest.
stdfloat or np.array or list of numbers
The term std is used to calculate the excess variance of a band.
If std is set to None, default Poisson case is taken and the
std is calculated as mean(lc)**0.5. In the case of a single
float as input, the same is used as the standard deviation which
is also used as the std. And if the std is an iterable of
numbers, their mean is used for the same purpose.
References
[1] Wilkinson, T. and Uttley, P. (2009), Accretion disc variability in the hard state of black hole X-ray binaries. Monthly Notices of the Royal Astronomical Society, 397: 666–676. doi: 10.1111/j.1365-2966.2009.15008.x
An array of arrays with mid point band_interest and their
covariance. It is the array-form of the dictionary energy_covar.
The covariance values are unnormalized.
data contains the time series data, either in the form of a
2-D array of (timestamp,energy) pairs for event data, or as a
list of stingray.Lightcurve objects.
Note : The event list must be in sorted order with respect to the
times of arrivals.
segment_sizefloat
The length of each segment in the averaged covariance spectrum.
The number of segments will be calculated automatically using the
total length of the data set and the segment_size defined here.
dtfloat
The time resolution of the stingray.Lightcurve formed
from the energy bin. Only used if data is an event list.
band_interest{None, iterable of tuples}
If None, all possible energy values will be assumed to be of
interest, and a covariance spectrum in the highest resolution
will be produced.
Note: if the input is a list of stingray.Lightcurve objects,
then the user may supply their energy values here, for construction of a
reference band.
Defines the reference band to be used for comparison with the
bands of interest. If None, all bands except the band of
interest will be used for each band of interest, respectively.
Alternatively, a tuple can be given for event list data, which will
extract the reference band (always excluding the band of interest),
or one may put in a single stingray.Lightcurve object to be used (the same
for each band of interest) or a list of stingray.Lightcurve objects, one for
each band of interest.
stdfloat or np.array or list of numbers
The term std is used to calculate the excess variance of a band.
If std is set to None, default Poisson case is taken and the
std is calculated as mean(lc)**0.5. In the case of a single
float as input, the same is used as the standard deviation which
is also used as the std. And if the std is an iterable of
numbers, their mean is used for the same purpose.
References
Attributes:
unnorm_covarnp.ndarray
An array of arrays with mid point band_interest and their
covariance. It is the array-form of the dictionary energy_covar.
The covariance values are unnormalized.
Create a Stingray Object object from data in an Astropy Table.
The table MUST contain at least a column named like the
main_array_attr.
The rest of columns will form the array attributes of the
new object, while the attributes in ds.attrs will
form the new meta attributes of the object.
Create an StingrayObject object from data in a pandas DataFrame.
The dataframe MUST contain at least a column named like the
main_array_attr.
The rest of columns will form the array attributes of the
new object, while the attributes in ds.attrs will
form the new meta attributes of the object.
Since pandas does not support n-D data, multi-dimensional arrays can be
specified as <colname>_dimN_M_K etc.
See documentation of make_1d_arrays_into_nd for details.
Create a StingrayObject from data in an xarray Dataset.
The dataset MUST contain at least a column named like the
main_array_attr.
The rest of columns will form the array attributes of the
new object, while the attributes in ds.attrs will
form the new meta attributes of the object.
the frequency range over which calculating the variability quantity
energy_speclist or tuple (emin,emax,N,type)
if a list is specified, this is interpreted as a list of bin edges;
if a tuple is provided, this will encode the minimum and maximum
energies, the number of intervals, and lin or log.
Other Parameters:
ref_band[emin,emax], floats; default None
minimum and maximum energy of the reference band. If None, the
full band is used.
the frequency range over which calculating the variability quantity
energy_speclist or tuple (emin,emax,N,type)
if a list is specified, this is interpreted as a list of bin edges;
if a tuple is provided, this will encode the minimum and maximum
energies, the number of intervals, and lin or log.
Other Parameters:
ref_band[emin,emax], floats; default None
minimum and maximum energy of the reference band. If None, the
full band is used.
use_pibool, default False
Use channel instead of energy
Attributes:
events1array-like
list of events used to produce the spectrum
freq_intervalarray-like
interval of frequencies used to calculate the spectrum
energy_intervals[[e00,e01],[e10,e11],...]
energy intervals used for the spectrum
spectrumarray-like
the spectral values, corresponding to each energy interval
Add the array values of two StingrayObject instances element by element, assuming
the main array attributes of the instances match exactly.
All array attrs ending with _err are treated as error bars and propagated with the
sum of squares.
GTIs are crossed, so that only common intervals are saved.
Parameters:
otherStingrayTimeseries object
A second time series object
Other Parameters:
operated_attrslist of str or None
Array attributes to be operated on. Defaults to all array attributes not ending in
_err.
The other array attributes will be discarded from the time series to avoid
inconsistencies.
error_attrslist of str or None
Array attributes to be operated on with error_operation. Defaults to all array
attributes ending with _err.
error_operationfunction
Function to be called to propagate the errors
inplacebool
If True, overwrite the current time series. Otherwise, return a new one.
Apply a mask to all array attributes of the object
Parameters:
maskarray of bool
The mask. Has to be of the same length as self.time
Returns:
ts_newStingrayObject object
The new object with the mask applied if inplace is False, otherwise the
same object.
Other Parameters:
inplacebool
If True, overwrite the current object. Otherwise, return a new one.
filtered_attrslist of str or None
Array attributes to be filtered. Defaults to all array attributes if None.
The other array attributes will be set to None. The main array attr is always
included.
Clean up the list of attributes, only giving out those pointing to data.
List all the attributes that point directly to valid data. This method goes through all the
attributes of the class, eliminating methods, properties, and attributes that are complicated
to serialize such as other StingrayObject, or arrays of objects.
This function does not make difference between array-like data and scalar data.
Returns:
data_attributeslist of str
List of attributes pointing to data that are not methods, properties,
or other StingrayObject instances.
Create a Stingray Object object from data in an Astropy Table.
The table MUST contain at least a column named like the
main_array_attr.
The rest of columns will form the array attributes of the
new object, while the attributes in ds.attrs will
form the new meta attributes of the object.
Create an StingrayObject object from data in a pandas DataFrame.
The dataframe MUST contain at least a column named like the
main_array_attr.
The rest of columns will form the array attributes of the
new object, while the attributes in ds.attrs will
form the new meta attributes of the object.
Since pandas does not support n-D data, multi-dimensional arrays can be
specified as <colname>_dimN_M_K etc.
See documentation of make_1d_arrays_into_nd for details.
Create a StingrayObject from data in an xarray Dataset.
The dataset MUST contain at least a column named like the
main_array_attr.
The rest of columns will form the array attributes of the
new object, while the attributes in ds.attrs will
form the new meta attributes of the object.
List the names of the internal array attributes of the Stingray Object.
These are array attributes that can be set by properties, and are generally indicated
by an underscore followed by the name of the property that links to it (E.g.
_counts in Lightcurve).
By array attributes, we mean the ones with the same size and shape as
main_array_attr (e.g. time in EventList)
the frequency range over which calculating the variability quantity
energy_speclist or tuple (emin,emax,N,type)
if a list is specified, this is interpreted as a list of bin edges;
if a tuple is provided, this will encode the minimum and maximum
energies, the number of intervals, and lin or log.
Other Parameters:
ref_band[emin,emax], floats; default None
minimum and maximum energy of the reference band. If None, the
full band is used.
Return a pretty-printed string representation of the object.
This is useful for debugging, and for interactive use.
Other Parameters:
func_to_applyfunction
A function that modifies the attributes listed in attrs_to_apply.
It must return the modified attributes and a label to be printed.
If None, no function is applied.
any other formats compatible with the writers in
astropy.table.Table (ascii.ecsv, hdf5, etc.)
Files that need the astropy.table.Table interface MUST contain
at least a column named like the main_array_attr.
The default ascii format is enhanced CSV (ECSV). Data formats
supporting the serialization of metadata (such as ECSV and HDF5) can
contain all attributes such as mission, gti, etc with
no significant loss of information. Other file formats might lose part
of the metadata, so must be used with care.
..note:
Complex values can be dealt with out-of-the-box in some formats
like HDF5 or FITS, not in others (e.g. all ASCII formats).
With these formats, and in any case when fmt is ``None``, complex
values should be stored as two columns of real numbers, whose names
are of the format <variablename>.real and <variablename>.imag
Parameters:
filename: str
Path and file name for the file to be read.
fmt: str
Available options are ‘pickle’, ‘hea’, and any Table-supported
format such as ‘hdf5’, ‘ascii.ecsv’, etc.
Subtract all the array attrs of two StingrayObject instances element by element, assuming the main array attributes of the instances match exactly.
All array attrs ending with _err are treated as error bars and propagated with the
sum of squares.
GTIs are crossed, so that only common intervals are saved.
Parameters:
otherStingrayTimeseries object
A second time series object
Other Parameters:
operated_attrslist of str or None
Array attributes to be operated on. Defaults to all array attributes not ending in
_err.
The other array attributes will be discarded from the time series to avoid
inconsistencies.
error_attrslist of str or None
Array attributes to be operated on with error_operation. Defaults to all array
attributes ending with _err.
error_operationfunction
Function to be called to propagate the errors
inplacebool
If True, overwrite the current time series. Otherwise, return a new one.
Array attributes (e.g. time, pi, energy, etc. for
EventList) are converted into columns, while meta attributes
(mjdref, gti, etc.) are saved into the meta dictionary.
Other Parameters:
no_longdoublebool
If True, reduce the precision of longdouble arrays to double precision.
This needs to be done in some cases, e.g. when the table is to be saved
in an architecture not supporting extended precision (e.g. ARM), but can
also be useful when an extended precision is not needed.
Array attributes (e.g. time, pi, energy, etc. for
EventList) are converted into columns, while meta attributes
(mjdref, gti, etc.) are saved into the ds.attrs dictionary.
Since pandas does not support n-D data, multi-dimensional arrays are
converted into columns before the conversion, with names <colname>_dimN_M_K etc.
See documentation of make_nd_into_arrays for details.
Array attributes (e.g. time, pi, energy, etc. for
EventList) are converted into columns, while meta attributes
(mjdref, gti, etc.) are saved into the ds.attrs dictionary.
any other formats compatible with the writers in
astropy.table.Table (ascii.ecsv, hdf5, etc.)
..note:
Complex values can be dealt with out-of-the-box in some formats
like HDF5 or FITS, not in others (e.g. all ASCII formats).
With these formats, and in any case when fmt is ``None``, complex
values will be stored as two columns of real numbers, whose names
are of the format <variablename>.real and <variablename>.imag
Parameters:
filename: str
Name and path of the file to save the object list to.
fmt: str
The file format to store the data in.
Available options are pickle, hdf5, ascii, fits
Upper limit on a sinusoidal modulation, given a measured power in the PDS/Z search.
Eq. 10 in Vaughan+94 and a_from_ssig: they are equivalent but Vaughan+94
corrects further for the response inside an FFT bin and at frequencies close
to Nyquist. These two corrections are added by using fft_corr=True and
nyq_ratio to the correct \(f / f_{Nyq}\) of the FFT peak
To understand the meaning of this amplitude: if the modulation is described by:
..math:: p = overline{p} (1 + a * sin(x))
this function returns a.
If it is a sum of sinusoidal harmonics instead
..math:: p = overline{p} (1 + sum_l a_l * sin(lx))
a is equivalent to \(\sqrt(\sum_l a_l^2)\).
The number of counts in the light curve used to calculate the spectrum
Returns:
a: float
The modulation amplitude that could produce P>pmeas with 1 - c probability
Other Parameters:
n: int
The number of summed powers to obtain pmeas. It can be multiple
harmonics of the PDS, adjacent bins in a PDS summed to collect all the
power in a QPO, or the n in Z^2_n
c: float
The confidence value for the probability (e.g. 0.95 = 95%)
fft_corr: bool
Apply a correction for the expected power concentrated in an FFT bin,
which is about 0.773 on average (it’s 1 at the center of the bin, 2/pi
at the bin edge.
nyq_ratio: float
Ratio of the frequency of this feature with respect to the Nyquist
frequency. Important to know when dealing with FFTs, because the FFT
response decays between 0 and f_Nyq similarly to the response inside
a frequency bin: from 1 at 0 Hz to ~2/pi at f_Nyq
Note:
This is stingray’s original implementation of the probability
distribution for the power spectrum. It is superseded by the
implementation in pds_probability for practical purposes, but
remains here for backwards compatibility and for its educational
value as a clear, explicit implementation of the correct
probability distribution.
Compute the probability of detecting the current power under
the assumption that there is no periodic oscillation in the data.
This computes the single-trial p-value that the power was
observed under the null hypothesis that there is no signal in
the data.
Important: the underlying assumptions that make this calculation valid
are:
the powers in the power spectrum follow a chi-square distribution
the power spectrum is normalized according to [Leahy 1983]_, such
that the powers have a mean of 2 and a variance of 4
there is only white noise in the light curve. That is, there is no
aperiodic variability that would change the overall shape of the power
spectrum.
Also note that the p-value is for a single trial, i.e. the power
currently being tested. If more than one power or more than one power
spectrum are being tested, the resulting p-value must be corrected for the
number of trials (Bonferroni correction).
Mathematical formulation in [Groth 1975]_.
Original implementation in IDL by Anna L. Watts.
Parameters:
powerfloat
The squared Fourier amplitude of a spectrum to be evaluated
nspecint
The number of spectra or frequency bins averaged in power.
This matters because averaging spectra or frequency bins increases
the signal-to-noise ratio, i.e. makes the statistical distributions
of the noise narrower, such that a smaller power might be very
significant in averaged spectra even though it would not be in a single
power spectrum.
Returns:
pvalfloat
The classical p-value of the observed power being consistent with
the null hypothesis of white noise
Number of Gaussian sigmas corresponding to tail probability.
This function computes the value of the characteristic function of a
standard Gaussian distribution for the tail probability equivalent to the
provided p-value, and turns this value into units of standard deviations
away from the Gaussian mean. This allows the user to make a statement
about the signal such as “I detected this pulsation at 4.1 sigma
The example values below are obtained by brute-force integrating the
Gaussian probability density function using the mpmath library
between Nsigma and +inf.
Calculate the single-trial p-value from a total p-value
Let us say that we want to reject a null hypothesis at the
pn level, after executing n different measurements.
This might be the case because, e.g., we
want to have a 1% probability of detecting a signal in an
entire power spectrum, and we need to correct the detection
level accordingly.
The typical procedure is dividing the initial probability
(often called _epsilon_) by the number of trials. This is
called the Bonferroni correction and it is often a good
approximation, when pn is low: p1=pn/n.
However, if pn is close to 1, this approximation gives
incorrect results.
Here we calculate this probability by inverting the Binomial
problem. Given that (see p_multitrial_from_single_trial)
the probability of getting more than one hit in n trials,
given the single-trial probability p, is
\[P (k \geq 1) = 1 - (1 - p)^n,\]
we get the single trial probability from the multi-trial one
from
\[p = 1 - (1 - P)^{(1/n)}\]
This is also known as Šidák correction.
Parameters:
pnfloat
The significance at which we want to reject the null
hypothesis after multiple trials
nint
The number of trials
Returns:
p1float
The significance at which we reject the null hypothesis on
each single trial.
Return the detection level (with probability 1 - epsilon) for a Power
Density Spectrum of nbins bins, normalized a la Leahy (1983), based on
the 2-dof \({\chi}^2\) statistics, corrected for rebinning (n_rebin)
and multiple PDS averaging (n_summed_spectra)
Parameters:
epsilonfloat
The single-trial probability value(s)
Other Parameters:
ntrialint
The number of independent trials (the independent bins of the PDS)
n_summed_spectraint
The number of power density spectra that have been averaged to obtain
this power level
n_rebinint
The number of power density bins that have been averaged to obtain
this power level
Give the probability of a given power level in PDS.
Return the probability of a certain power level in a Power Density
Spectrum of nbins bins, normalized a la Leahy (1983), based on
the 2-dof \({\chi}^2\) statistics, corrected for rebinning (n_rebin)
and multiple PDS averaging (n_summed_spectra)
Parameters:
levelfloat or array of floats
The power level for which we are calculating the probability
Returns:
epsilonfloat
The probability value(s)
Other Parameters:
ntrialint
The number of independent trials (the independent bins of the PDS)
n_summed_spectraint
The number of power density spectra that have been averaged to obtain
this power level
n_rebinint
The number of power density bins that have been averaged to obtain
this power level
The number of counts in the light curve used to calculate the spectrum
Returns:
pf: float
The pulsed fraction that could produce P>pmeas with 1 - c probability
Other Parameters:
n: int
The number of summed powers to obtain pmeas. It can be multiple
harmonics of the PDS, adjacent bins in a PDS summed to collect all the
power in a QPO, or the n in Z^2_n
c: float
The confidence value for the probability (e.g. 0.95 = 95%)
fft_corr: bool
Apply a correction for the expected power concentrated in an FFT bin,
which is about 0.773 on average (it’s 1 at the center of the bin, 2/pi
at the bin edge.
nyq_ratio: float
Ratio of the frequency of this feature with respect to the Nyquist
frequency. Important to know when dealing with FFTs, because the FFT
response decays between 0 and f_Nyq similarly to the response inside
a frequency bin: from 1 at 0 Hz to ~2/pi at f_Nyq
Confidence limits on power, given a (theoretical) signal power.
This is to be used when we expect a given power (e.g. from the pulsed
fraction measured in previous observations) and we want to know the
range of values the measured power could take to a given confidence level.
Adapted from Vaughan et al. 1994, noting that, after appropriate
normalization of the spectral stats, the distribution of powers in the PDS
and the Z^2_n searches is always described by a noncentral chi squared
distribution.
Parameters:
preal: float
The theoretical signal-generated value of power
Returns:
pmeas: [float, float]
The upper and lower confidence interval (a, 1-a) on the measured power
Other Parameters:
n: int
The number of summed powers to obtain the result. It can be multiple
harmonics of the PDS, adjacent bins in a PDS summed to collect all the
power in a QPO, or the n in Z^2_n
Upper limit on signal power, given a measured power in the PDS/Z search.
Adapted from Vaughan et al. 1994, noting that, after appropriate
normalization of the spectral stats, the distribution of powers in the PDS
and the Z^2_n searches is always described by a noncentral chi squared
distribution.
Note that Vaughan+94 gives p(pmeas | preal), while we are interested in
p(real | pmeas), which is not described by the NCX2 stat. Rather than
integrating the CDF of this probability distribution, we start from a
reasonable approximation and fit to find the preal that gives pmeas as
a (e.g.95%) confidence limit.
As Vaughan+94 shows, this power is always larger than the observed one.
This is because we are looking for the maximum signal power that,
combined with noise powers, would give the observed power. This involves
the possibility that noise powers partially cancel out some signal power.
Parameters:
pmeas: float
The measured value of power
Returns:
psig: float
The signal power that could produce P>pmeas with 1 - c probability
Other Parameters:
n: int
The number of summed powers to obtain pmeas. It can be multiple
harmonics of the PDS, adjacent bins in a PDS summed to collect all the
power in a QPO, or the n in Z^2_n
c: float
The confidence value for the probability (e.g. 0.95 = 95%)
stingray.gti.bin_intervals_from_gtis(gtis, segment_size, time, dt=None, fraction_step=1, epsilon=0.001)[source]¶
Compute start/stop times of equal time intervals, compatible with GTIs,
and map them to the indices of an array of time stamps.
Used to start each FFT/PDS/cospectrum from the start of a GTI,
and stop before the next gap in data (end of GTI).
In this case, it is necessary to specify the time array containing the
times of the light curve bins.
Returns start and stop bins of the intervals to use for the PDS.
Parameters:
gtis2-d float array
List of GTIs of the form [[gti0_0,gti0_1],[gti1_0,gti1_1],...].
segment_sizefloat
Length of each time segment.
timearray-like
Array of time stamps.
Returns:
spectrum_start_binsarray-like
List of starting bins in the original time array to use in spectral
calculations.
spectrum_stop_binsarray-like
List of end bins to use in the spectral calculations.
Other Parameters:
dtfloat, default median(diff(time))
Time resolution of the light curve.
epsilonfloat, default 0.001
The tolerance, in fraction of dt, for the comparisons at the
borders.
fraction_stepfloat
If the step is not a full segment_size but less (e.g. a moving
window), this indicates the ratio between step step and
segment_size (e.g. 0.5 means that the window shifts by half
segment_size).
A mask labelling all time stamps that are included in the GTIs versus
those that are not.
new_gtisNx2 array
An array of new GTIs created by this function.
Other Parameters:
safe_intervalfloat or [float,float], default None
A safe interval to exclude at both ends (if single float) or the start
and the end (if pair of values) of GTIs. If None, no safe interval
is applied to data.
min_lengthfloat
An optional minimum length for the GTIs to be applied. Only GTIs longer
than min_length will be considered when creating the mask.
return_new_gtisbool
If True`, return the list of new GTIs (if min_length>0)
dtfloat
Time resolution of the data, i.e. the interval between time stamps.
epsilonfloat
Fraction of dt that is tolerated at the borders of a GTI.