BDS Release Notes
Release 2.0.4 - 2012-12-10
Minor bugfix release.
- bdsGui programs: When converting a PoleZero response to an FAP
table from response Metadata, the system would use a calibration and
sample frequency of 1 Hz. It now uses the values from the first
calibration entry starting from the responses start time.
- 1334: bdsMetadata let pole-zero or FAP filename be variable
- 1335: bdsMetadata using variable for "split time" this has now been implemented.
- 1320: When creating a new channel with a "network" other than "BN", GUI queries Do you Really...
- 1319: Allow "network" to be changed in Clone Channel dialogue
- 1318: bdsImportTapeDigitiserData sample rate error Added -ignoreSampleRate flag.
- 1336: bdsMetadata "list" and "find" on Sensors and Digitisers tables Added support for normal channel selections.
- 1118: allow "maxChanges" in bdsMetadata to be changed within a script file Added ability to set maxChanges from program using the $maxChanges variable.
- bdsMetadata: Now issues an error if an unknown selection parameter is given.
- 1164: in addWarnings, if no endTime is specified, it defaults to 0000-01-01 Now sets endTime equal to data's end time if not set. Also checks users times given are within the file.
Release 2.0.3 - 2012-10-24
Minor bugfix release.
- bdsMetadata: "add Response" is not working with variables for the reponse to use. Fixed.
- bdsImportTapeDigitriserData: Session numbers above 7 failed due to reading sessions numbers as octal. Fixed.
- 1321: mport FAP using AdminGUI The BDS database used a "text" field type for the response storage. this
was too small so the database sechma has been updated to version 12
with a "mediumtext" field.
With this release there are updates to the database Schema to
version 12. There
is an additional command "bdsDatabaseUpdate" that should be run after
package update. This will update the database schema and modify
appropriate entries. So the update process is:
- Shutdown bdsServer: "service bdsServer stop"
- Update the BDS software: "yum update"
- Update the database schema: "bdsDatabaseUpdate -u bdsMain -p
bdsMain"
- Restart the BDS system. "bdsRestart"
Release 2.0.2 - 2012-10-03
Minor bugfix release.
- BdsMetadata: "add ChannelInstrument" was expaning member variables twice.
- BdsMetadata: The split time argument can now be a variable.
- BdsImportCd: Changed to ignore imports from 23:00:00 to 01:00:00 to allow for end of day file sync.
- BdsImportTapeDigitiserData: The -timecodeIgnoreTimeJumps flag failed to work.
- BdsDataFileCd: Now returns an error when no Data Format block is present at the start of a CD1.0 file.
Release 2.0.1 - 2012-08-13
Minor bugfix release.
- bdsImportTapeDigitiserData would segment fault on older
TapeDigitiser data files which had not been re-processed with TapeView
and where the cursors startSample and endSample fields were not set.
- BDS SEED export. Added a 58 blockette for the stage 1 gain.
- 1259: msr_pack: No samples to pack when downloading H08 data as SEED Have fixed the "Error: BdsDataFileSeedError: msr_pack(BN_H11C2_US_LEA_):
No samples to pack" problem. Was caused due to a block time calculation
that in this instance of data request, block sizes, and time offsets
caused a block of 0 bytes to be returned.
- BdsSeed:
Fixed a bug where if there were multiple channels per station in the
data then the Station headers would be incorrectly output.
- 1270: rdseed failure for SEED files with many data segments
There was a minor bug with continuation of SEED data records which
should make sure at least the blockette type and length fields were not
split across records.
Release 2.0.0 - 2012-07-27
- 1198: Cannot delete StationLocation from AdminGUI. The BdsServer now deletes StationLocations when station is deleted.
- 1199: be able to export responses even where there are no data. BdsDataAccess: Modified response output to work when no data is present.
- 1200: warnings issued during TapeDigitiser import and export. BdsDataLib: Fixed bug where Qaulity Notes were placed under the source Main rather than TapeDigitiser. This
does mean than any existing imports will have the Notes incorrectly set
in the BDS database. This can be corrected with a database script
(setting the source to "TapeDigitiser" for all Notes where the title
starts with "Quality" will probably be fine). The warnings
"Warning in executing bdsTapeDigitiserFile" which occuerd are no longer
stored.
- 1201: v 1.2.22 does not write responses.
BdsDataLib: Fixed bug 1201: v 1.2.22 does not write responses. Now
writes IMS responses when set to IMS-2.0-CM6 and other sub formats.
- 1207: "name" in "Response" edit window. Fixed BWEditComboBox bug.
- BdsTapeDigitiserFile: Fixed bug with small files when wrong
timecode type was set. In this case the program did not copy any data
to the output file.
- 1203: Output SEED format data with FAP files; verseed output; rdseed.
BdsSeed data format was not handling large FAP tables properly, the
data was crossing block boundaries without a continuation block
indicator.
- 1219: After "split at time", "Create New Digitiser/Sensor" button overwrites old. This has been fixed.
- Modified TapeDigitiser import. Now responds to tapeView
introduced: startSample,endSample,ignore and allows VelaPll and VelaStd
timecode types.
- 1223: bdsMetadata "list" on ChannelInstrument. Added the ability to get lists of ChannelInstruments without specifying the channelId.
- 1221: plit calibration in bdsMetadata bdsMetaData should support "split Calibration", and in fact does do so
but will return the wrong error message when the number of changes is
exceeded have fixed this. Also added support for spliting ChannelInstruments.
- BdsMetadata: Added support for varibles to be used in the
parameter seting section of BdsMetadata commands. Also have added the
"print" command (with no arguments) to print all variables.
- BdsImportBlacknestDatabase: Added verfification of station and channel names during import.
- 1231: BdsGui: File selection lost when you save a mod to a channel in Data Files tab This has been fixed.
- 1232: bdsImportBlacknestDatabase interpretation of "AHT" and "AST" This has been implemented.
- BdsServer: Modified missing data errors to list channel information.
- 1249: WRA_AGSO sampling rate There was an issue in the BdsServer
data gathering and export code to do with time calculations. This would
have affected all exports of all data types where there was a lot of
separate segments of data. This has been fixed.
- 1248: YKA tar SEED all except first file have locn code "YK" BdsImportData: Fixed a bug where the network and station location where not
overriden in the special case for YKA SEED data from 1991-07-10 to 1995-09-01.
- 1253: Cloning calibrations Found that this command had accidentialy been effectively removed when the command "clone Location" was added.
Release 1.2.22 - 2012-05-08
- Added support to BDS GUI applications to show FAP responses when exporting from seismic data tab.
- Added ability to export FAP responses in SEED sensor data exports.
- Added ability to export in EVALRESP (FAP) format from PoleZero responses.
- Added mode and status metadata to CD1.x imports so that calibration info can be retrieved from data blocks.
- Changed some channel types in bdsImportBlacknestDatabase for Bug: 1172.
- IMS format export now includes Responses in PoleZero or FAP by default.
- BdsGui applications: Added "No Metadata" tickbox on data export.
This reduces the amount of Metadata included in the export files.
Mainly this means no response data.
- BdsDataAccess:
Added the "-noMetadata" flag. This reduces the amount of Metadata
included in any export files. Mainly this means no response data.
- BdsGui: Changed "Response" field name to "Name" in Response
dialog and made this an editable field so any value cane be entered.
- BdsMetadata: Added ability to change Response.
- CD1.x data import now imports channels marked as down and/or zeroed with a data quality warning included in the BDS data file.
- Now only reads and uses the first PoleZero response in IDC-format PAZFIR files.
- BdsGui: Added ability to download responses from the MetaData information tabs.
- Now prefixes the response file's extention with "fap" or "polezero" as appropriate by default.
- Note that the BDS API has been updated in this
release, so any client applications will need re-compiling.
Release 1.2.21 - 2012-04-24
- bdsImportCd: Now only looks in directories that have a digit as
their first character. This stops warnings about trying to access
lost+found.
- Have set bdsImportTapeDigitiser to continue with the Timecode processing even if no Timecode has been found for 4 hours.
- Modified wording for "Duplicate Block" during data conversion.
- BdsMetadata: Added support for FAP and FIR responses.
- BdsMetadata: Modified "list response" to return actual responce data.
- BdsMetadata: Added "read" command to read responses from files.
- BdsGui programs: Added support for FAP responses.
- Modified BdsDataFileCd to only check relevent channels during duplicate block check.
- Added ability to export FAP responses in EVALRESP format in BdsGui applications and bdsDataAccess.
- Modified default response file name to include response type (polezero, fap).
- CD1.x data convertor: Added support for "-ignoreCorruptions" flag
in bdsImportData. If a currupt (short) block is found, it will be
ignored and the next valid block found. This is now the default in
bdsImportCd.
- The CD1.x imported was setting the number of blocks in a data
files channel to one less than there were. This would have affected
sample rate calculations.
- Added support for multi-segment data import. This allows CD1.X
data files to be imported as separate segments of data into one BDS
data file. So CD1.x data files that have sets of data over different
time periods can be imported and used easily without the issue of
"missing blocks" errors. Currently gaps of greater than 1 hour result in these database segments.
Release 1.2.20 - 2012-03-19
- Fixed bug where CD1.x file import would fail with "std::length_error" on cd1.0 files without channel authorisation.
- Fixed file descriptor leak when file import errors.
- Fixed time stored in bdsImortCdTimes.cache.
- BdsDataFileDump: Added support for -blocks command to display block timestamps etc.
- Fixed
problem with DataInfo startTimes not being set correctly when blocks
ordering is completely incorrect on CD1.x and GCF files.
- BdsImportCd: Added file import log in /var/log/bds/bdsImportCd.log.
- Moved logrotate bits to bds package.
Release 1.2.19 - 2012-03-15
- Fixed crash bug in bdsImportCd/bdsImportData.
- Added validation of authSize filed in CD1.1 data frames to eliminate a crash whith currupt data files.
- Modified bdsTestCreateMetaData to create responses with equal poles/zeros.
- Fixed a crash in the BdsServer where the incoming data block was not being fully validated.
- Modified the CD1.X data converter to use ChannelMultiplexed data
rather than SampleMultiplexed data due to a feq data files having
missing chunks of data on a per channel basis.
- BdsServer: Added support for calibrations with name = Measured.
These entries can overlap normal calibrations and have there startTime
and endTime equal if desired. All data exports ignore calibrations with
a name of Measured.
- Added calibrationName to selection mechanism.
- Added calibrations command to bdsDataAccess.
- CD1.x data convertor: Set the maximum TIMESTAMP_JITTER to 1% of the block time rather than 0.1%.
- Note that the BDS API has been updated in this
release, so any client applications will need re-compiling.
Release 1.2.18 - 2012-03-12
This is a minor update, fixing some small bugs.
- BdsImportCd has been modified to ignore the curent days files when importing.
- Fixed
a bug in CD1.1 import where a block with missing channels and short
numbers of samples would cause a samplerate validation error.
- The CD1.1 data convertor now ignores "Type 7" frames. These are
an alert frame that indicates that the connection is about to be
terminated.
- BdsMetadata added support for listing and changing
ChannelInstruments. This requires the updated bdsServer program as well
as bdsMetadata.
- Changed SEED export to set Blockette 53's normFactor to be 1/gain.
- Modified VELA PLL Timecode system for more efficient memory usage. This now allows at least 48 hours with no time codes.
- Added code to allow continuation of VELA PLL Timecode system beyond 48 hours of no time codes.
- Modified tapeView to not recode timecodes before start cursor.
Release 1.2.17 - 2011-10-07
This is a minor update, fixing some small bugs found in the 1.2.15
release and adding Hutchins timecode support.
- BdsImportTapedigitiserData and bdsTapedigitiserFile: Modified
"-timecode" timecode type fields to "Manual, Vela or Hutchins" with
parameter checking.
- BdsImportTapedigitiserData and bdsTapedigitiserFile: Changed -velaStartTime to -timecodeStartTime etc.
- Fixed bug in bdsImportTapeDigitiserData where it crashed with data files > 4GByte.
Release 1.2.16 - 2011-09-19
This is a minor update, fixing some small bugs found in the 1.2.15
release and adding Hutchins timecode support.
- 1144: Problm exporting CD-1.1 data from hydrophone array H08
Have found this bug due to the timestamp jitter algorithm not resetting new endblock times. Have fixed this.
Release 1.2.15 - 2011-09-14
This is a minor update, fixing some small bugs found in the 1.2.14
release and adding Hutchins timecode support.
- Added support for Hutchins and Manual Timecode re-processing in bdsImportTapeDigitiser and bdsTapeDigitiserFile.
- Fixed CD1.X data import bug were endian was incorrect.
- Modified CD1.X data converter to issue MissingBlocks errors/warnings when Channel SubFrames have no data (numSamples == 0).
Release 1.2.14 - 2011-08-31
This is a minor update, fixing some small bugs found in the 1.2.13
release.
- 1138: Problems specifying "Station" This has been fixed.
- BdsServer: Added ability to select sensors and digitisers from
channel selection criteria. This allows sensorsGetList() and
digitiserGetList() to return a selection based on the channel selection
crteria.
- bdsMetadata: Changed bdsMetadata to set the sensors oldId field to 0 on cloning.
Release 1.2.13 - 2011-08-11
This is a minor update, fixing some small bugs found in the 1.2.12
release.
- 1110: Signs of poles and zeros entered in bdsMetadata This has been fixed.
- 1113: inconsistent channelType and channelAux in bdsMetadata "clone" This has been fixed.
- 1116: Two queries about interpretation of command files by bdsMetadata I have fixed the line number error reporting when "/* */" comments are used.
- bdsMetdata, the default variables were not setup. These are now setup as per the manual.
- 1114: Cloning in bdsMetadata does not alter dates for all the cloned lines.
The system now sets the start and end times of the calibrations,
responses, and instruments to the new channel settings. It also only
clones the Calibrations,Reponses and Instruments within the newly
created Channels time range if more than one Calibrations,Reponses and Instruments are selected.
- 1131: BdsMetadata: Add flag to give BdsServer name.
The bdsMetadata program now has to be given the "-name <server
name>" flag with the name of the server beeing connected to. This is
an assitional safety check.
Release 1.2.12 - 2011-07-25
This update adds support for the CD1.x data format and adds the
bdsMetadata manipulation program. As well as these and a few extra
small features, it fixies some small bugs found in the 1.2.11
release.
- 1093: Add ability for normal users to change their password. There is now a menu item in the File menu allowing the
user to change their details in the bdsUserGui and bdsAdminGui programs.
There is no command line support for this as yet.
- 1091: Non-synchronously sampled data from two or more 3-component stns served in BKNAS-1. Fixed this.
- Added the bdsDataManage utilty in the package bds-extra.
- Fixed bdsDataManage wild cards and set dryRun as default.
- Added the "-ignoreVelaReprocessingErrors" flag to bdsImportTapeDigitiser to ignore VELA re-processing errors.
- Fixed bug on import wehre imp[ort would loop on first file in directory.
- Added data convertor for CD1.0 and CD1.1 support.
- Added bdsImportCd a daemon to import CD1.X data files recieved over the network.
- Modified bdsImportScream to re-order blocks, allow duplicate blocks and ignore missing blocks during import.
- Modified bdsImportScream to also add import validation warnings to the BDS Notes system.
- Added the ability for the bdsServer to ignore minor time
discontinuities when exporting data. Any discontinutity less than 0.1%
of a blocks time period will be taken to be a clock resynchronisation
event.
- Fixed bug in BdsServer where ArrayChannels were not deleted when an array was deleted.
- Changed the bdsServer to delete the Calbrations,Responces and Instruments for a channel when a channel is deleted.
- Added
database backup and restore API to the BdsApi. This allows the BDS
database and server configuration to be backed up into the Backup
directory of the currently writeable datastore.
- Added the bdsManage program. This runs as an Admin user and
peforms the work of bdsControl but with additional functionality. This
includes database backup and restore.
- 1016: BDS database looses data if a transaction from another program is cancelled. Each BDS client connection now has its own database connection and so is
independent of other clients. This also has the side effect of speeding
up BDS access when another client is performing a large database
search.
- Added the "readOnly" option to the BDS data store configuration
in the bdsServer. This allows a set of datastores to be marked
read-only. These will not be used for wriring new data. This is useful
for the creation of a test server sharing the seismic data of a main
server in read-only mode.
- Note that the BDS API has been updated in this
release, so any client applications will need re-compiling.
With this release there are updates to the database Schema to
version 11. Actually this is only the addition of the user bdsImportCd.
There
is an additional command "bdsDatabaseUpdate" that should be run after
package update. This will Update the database schema and modify
appropriate entries. So the update process is:
- Shutdown bdsServer: "service bdsServer stop"
- Update the BDS software: "yum update"
- Update the database schema: "bdsDatabaseUpdate -u bdsMain -p
bdsMain"
- Restart the BDS system. "bdsRestart"
Release 1.2.11 - 2010-12-14
This is a minor update, fixing some small bugs found in the 1.2.10
release.
- 1034: IMS response calib zero.
The formats of the calibrationfactor CAL2 and pole zero values in the
PAZ2 lines have been change from %f to %e. The calibrationfactor is now
output in nm/count rather than m/count in IMS exports (both sensor data
and meta data). This also applies to the ASCII and BKNAS data file
output convertors.
- BdsImportData/BdsImportTapeDigitiserData: The user supplied
-addWarning Network:Station:Channel:Source parameter was overriden with
values obtained from the data. The user setting now takes presidence.
Also added validation of Network,Station,Channel,Source parameters
passed against metadata.
- BdsAdminGui/BdsUserGui: Notes deletion was poping up
warning/error dialogs when deleting notes without documents attached.
This has been fixed.
- BdsImportTapeDigitiserData: We have added a test to make sure memory is not eausted when the data's VELA year is set to 0.
- 1039: Date-time widget "end time before start time" BdsAdminGui/BdsUserGui: Modified to not test for endTime < startTime while entering dates.
- Improved the performance of the dataSearch() API call when using arrays with multiple station/channel pairs.
- 1041: User GUI modification/delete buttons active
- 1047: trace viewer scaling BdsAdminGui/BdsUserGui: Now only auto scales data of type seismic together.
- 1054: bdsDataAccess reports zero calibs Changed to use scientific notaion for calibrationFactor.
- 1055: "data already present" error while importing TapeDigitiser data This has been fixed.
- 1057: TapeDigitiser multisession data with missing blocks - Notes table contains too many entries This has been fixed, also fixed in bdsImportData.
- bdsTapeDigitiserFile: Added ability to invert VELA and Error tracks.
- 1066: EKA3617 TapeDigitiser timecode problems with day 367 Fixed bug with VELA year wrap.
- 414: Database does not keep up with station/channel name change Modified API function stationUpdate to also modify all of its StationLocation entries.
- 1071: Make restricted stations invisible to unprivileged users
The data access bug 1072 has been fixed (Not checking all of the
segments in a multi-segment data request). We have added support for
completely masking stations if they are added to AccessGroups with a
time period 0001-01-01 to 9999-01-01.
- 1078: Tab name DataSelect in UserGUI or Sensor Data in AdminGUI
- 1073: DataPlot in bdsDataAccess fails for multichannel data with non-aligned block boundaries Now supports accessing random block sized data (GCF) in a sample multiplexed manner.
- The segment end time was not being set correctly on channels when
a MetaData occurred and the data blocking amougst the channels was
un-even.
- 943: calculated sampling rate does not match metadata when "Calibration" split not on block boundary
- Note that the BDS API has been updated in this
release, so any client applications will need re-compiling.
Release 1.2.10 - 2010-11-04
This is a minor update, fixing some small bugs found in the 1.2.9
release.
- BdsServer: Changed default "DataStoreMin" size to be 32GBytes.
- BdsServer:
Fixed bug in data store allocation with multiple data stores wherea
data file write error could occur due to insufficient space being
available.
- BdsImportBlacknestDatabase: Modified to set endTimes of "EKA:BHZ" channels rather than "EKA:BHZ_10" channels.
- BdsImportBlacknestDatabase: Modified to add location codes to channel types in ArrayChannels table.
- Modified Notes/Warnings system to include particular Station and Channel names when imporing from multiple channel files.
- 1003: incomplete "Data Info" Each files individual info is now preceeded by "file<n>" when multiple files are involved.
- 1006: Start time becomes end time in -addWarning
- 1009: pole-zero constant is inverse of correct value
- 1017: add oldId to list for "clone" or "share" an existing sensor
- 1016: Export error when "full blocks" not set (ref 952, 953, 965)
- 1029: BdsAdminGui: Raise Data info windows when appropriate button is pressed
- 1015: original file name of tar SEED files is given as the first /tmp file into which the tar SEED was untarred Now uses the original tar file name for all filename entries.
- Notes documents are now stored in a documents directory within the main data stores.
- Note that the BDS API has been updated in this
release, so any client applications will need re-compiling.
With this release there are updates to the database Schema to version 10. There
is an additional command "bdsDatabaseUpdate" that should be run after
package update. This will Update the database schema and modify
appropriate entries. So the update process is:
- Shutdown bdsServer: "service bdsServer stop"
- Update the BDS software: "yum update"
- Update the database schema: "bdsDatabaseUpdate -u bdsMain -p
bdsMain"
- Restart the BDS system. "bdsRestart"
Release 1.2.9 - 2010-10-21
This is a minor update, fixing some small bugs found in the 1.2.8
release.
- 995: out-of-place WID2 lines in IMS data exported with "segment merge" ticked Fixed a bug in merged segment output.
- 997: "SeismicUnknown" channels not finding metadata but spurious backslashes Now allows import of data into "seismicUknown" and "empty" data typed channels.
- 994: Duplicating/conjugating poles and zeros (see 784/792) Have changed this to add after the selected item.
- Added multiple hour long GCF like test data.
Release 1.2.8 - 2010-10-15
This release has a number of modifications for the first live BDS release. The core features added or changed are:
- The Warnings/Notes system has been overhauled. Note that the
bdsImportData's "-addWarning" syntax has changed. Note that due to this
there will be no Notes from previously imported data.
- Note that the /etc/bdsServer.conf file should be updated with the "DocDir:" entry. Info in /etc/bdsServer.conf.rpmnew.
- The bdsAdminGui's tab layout has been changed by using top level
windows for some of the previous tabs. The selectors have been merged
into one set of code although there are still separately settable
selectors. There are also quite a few changes to support the bdsUSerGui
program sharing the code base.
- The bdsUserGui progam and bdsNoteAppend programs has been added.
- Instrument response export has been added.
Detailed list of changes:
- Added support for -includeSessions flag in
bdsImportTapeDigitiserData.
- 925:
Unable to edit location of an array in bdsAdminGui Fixed.
- Have changed error messages in bdsTapeDigitiserFile to include
"Error:" or "Warning:" at start.
- The error "ErrorDataPresent" is now returned when bdsImportData
or bdsImportTapeDigitiserData fails to import when data is already
present.
- 932:
bdsImportTapeDigitiserData reports temporary filename Changed
bdsImportTapeDigitiserData to report original file name in errors.
- Modified SEED export to only list one station type 50 block per
station.
- 944:
TapeDigitiser import with extra files in directory
bdsImportTapeDigitiserData now only looks of files of the name format
"data-*.bs".
- 931:
bad_alloc while importing TapeDigitiser data bdsTapeDigitiserFile:
Added support for setting the error and vela track numbers with flags.
Returns an error if the VELA code could not be read for more than 4
hours. Added support for setting the correct VELA and Error channels
from the info in the JobInfo file to handle files with unusual VELA
code tracks..
- 945:
YKA SEED TAR files with currupted ends Added the -ignoreTarErrors
flag to bdsImportData command.
-
946:
SEED: Improve compatibility of output SEED export: The "#" can be
removed by setting the station alias. I have modified
bdsImportBlacknestDatabase to do this by default. The station block
numbers in blockette 11 have been fixed.
-
bdsImportBlacknestDatabase: Now adds a station alias for all
stations with a '#' character. This station alias has the '#' removed.
This allows export in all formats with station names not having a '#'
character.
- 36: Instrument Response Information: Accessing
Added support in the BdsUSerGui and BdsAdminGui programs for exporting
the sensors response in SAC-POLEZERO, IMS-POLEZERO and IMS-FAP formats.
- Added support to the bdsAdminGui, bdsUserGui, bdsDataAccess and bdsAutodrm programs to export sensor responses.
- 941: DataStoreMin ineffective if data file larger than value set, can cause data loss
- 952: Modify Full-blocks data export feature The new normal operation is to return all of the data requested
between the times stated to the nearest sample. Some channels may not
contain data at the start or end times (short channels). The
FullBlocks mode is the same as it was. There is an additional
option in the API to clip the data so that all channels are complete.
Block Start/End times were incorrect with time clipping, this has also
been fixed.
- Added support to the bdsAutodrm program to export sensor responses. Supports "GSE2.0"/"IMS" and "SAC" pole zero formats.
- The bdsAutodrm now support sthe "EMAIL" as well as "E-MAIL" commands.
- The bdsAutodrm now logs to the log system rather than the notes system.
- 950: Rationalise warnings/notes/logs
Major changes to data warnings and Notes system. All data import
warnings both by the system and user added ones, with -addWarning, are
now added to the BDS sensor data files and stored in the Notes database
table. Data warnings now have a start and end time so that only the
warnings relavent to the data being accessed will be shown on export.
Only the notes stored in the database are used for data notes
information. The warnings store in the file can be viewed in the
DataInfo tab wich shows all of the MetaData stored in the actual data
files. When accessing sensor data the GUI programs now have a
"DataNotes" window to view these notes. The Notes tab has also been
updated with a selector to select the notes required.
- The Notes system now has the ability to store documents in
various formats. The Notes database stores information on the format
(mime format info and normally the filename extension). The actual
document files are stored in a documents directory on the BdsServer
which is defined using the "DocDir" configuration parameter. There is a
new, command line, program named bdsNoteAppend that has the ability to
append notes with and without documents. Note that there is no way of
viewing these documents as yet although the API provides the mechanism for document reading.
- BdsAdminGui: Changed tab system. MetaData is all under one tab
with sub tabs. There is now one Sensor data tab that brings up top
level windows for the Traces, DataInfo etc.
- BdsAdminGui: Single selector widget for all selections. Separate instantiations for MetaData, SensorData and DataFiles.
- BdsAdminGui: Improved selection performance.
- BdsAdminGui: Disabled the ability to change the file DataChannel sample rate parameter.
- 49: BdsDataView GUI program Added BdsUserGui program for user access to the BDS system.
- 940: date-time widget sometimes has 5-digit year This has been fixed. It occured when there was no data in the system.
- 923: "Logs" tab info - should this be so easy to alter? And bugs in deleting and accepting new items
I have fixed the delete bug and added checking for the priority value.
I can remove the ability to delete/update log entries if wished.
- 916: Cannot display info in DataViewInfo tab if channel lacks metadata
We have added this ability. If the CalibrationFactor or calibrationFrequency values are 0 then
the system will set them to 1.0. It will also use the samplingRate as
defined in the data file and ignore the rate in the metadata if it is 0. Instrument MetaData data is currently ignored.
- BdsAutodrm: Added new help file. This file is stored in
/usr/bds/config/Help.txt and has been set as a package "noreplace" file
so that local changes will not be overwritten on BDS package updates.
- 890: Merge consequtive data segments on export. This has been added. There is an option in the bdsGui programs for this and bdsDataAccess has it enabled by default.
- 934: BdsImportData: only validate between startTime and endTime.
The bdsImportData command now only performs data validation between the
startTime and endTime values if set. Note that data curruption, data
reordering and filename time errors are still reported and noted.
- 982: is downloading in "BDS" format meant to work?
We have disabled the export of BDS files. This was intended to be an
internal format only. If wanted we can add support for exporting in
this format.
- TapeDigitiser data import. The block time stamps were not quiote
corrrect due to a bug in the ms to us conversion (could have been out
by up to 500ms).
- Note that the BDS API has been updated in this
release, so any client applications will need re-compiling.
With this release there are updates to the database Schema to version 9. There
is an additional command "bdsDatabaseUpdate" that should be run after
package update. This will Update the database schema and modify
appropriate entries. So the update process is:
- Shutdown bdsServer: "service bdsServer stop"
- Update the BDS software: "yum update"
- Update the database schema: "bdsDatabaseUpdate -u bdsMain -p
bdsMain"
- Restart the BDS system. "bdsRestart"
Release 1.2.7 - 2010-07-16
- Fixed the database creation scripts.
- 892:
database table ArrayChannels errors for "BKNI" entry:
Modified bdsImportBlacknestDatabase to set up the correct channels in
the ArrayChannels database table. Fixed a bug where spaces were
included in ArrayChannels station names.
- The admin email address list and AutoDrom station and channel
lsits also sufferend from having spaces included in the list components.
- Modified
bdsImportBlacknestDatabase to ignore metadata entries for channels with
the formats "GCFEKABBCD" and "GCFEKBCD". The source "EkaCD"
will probably be used for this data and has been added to the inital
database setup scripts. Note that for an
existing database the souce "EkaCD" will need to be added.
- 898:
start time when requested timespan includes staggered beginnings of data:
There was a bug in the BdsServer where if the user selected muliple
channels of channel multiplexd data begining or ending within a missing
block of data the BdsServer would segment fault. This has been fixed.
- No API or Database changes have been made with this release.
Release 1.2.6 - 2010-06-30
- Added "-allowOverlap" flag to bdsImportData program.
- Now stores the original import file name in the DataChannels
database table. This is accessible from the BDS API in the DataInfo
object. The bdsDataAccess programs "dataInfo" command will return this
information. There were also changes to bdsAdminGui to support this
feature.
- 887:
adminGui hangs during export of mixed-"source" data when timespan
includes start of one source
- Modified to store the full path name of the original import file.
- Added code to setup stdout to be in line buffered mode for
command line programs.
- Note that the BDS API has been updated in this
release, so any client applications will need re-compiling.
With this release there are updates to the database Schema to version
8. There
is an additional command "bdsDatabaseUpdate" that should be run after
package update. This will Update the database schema and modify
appropriate entries. So the update process is:
- Shutdown bdsServer: "service bdsServer stop"
- Update the BDS software: "yum update"
- Update the database schema: "bdsDatabaseUpdate -u bdsMain -p
bdsMain"
- Restart the BDS system. "bdsRestart"
Release 1.2.5 - 2010-06-21
- Fixed bug where data files were not moved to ./Deleted when
deleted.
- Modified data export to clip data to the sample level at
requested times rather than just make sure the data starts abd ends at
the sample sample.
- Disabled changing of DataChannel.importFormat field.
- Added support for calculating overal TapeDigitiser digitisation
quality values and displaying warnings on import and export.
- Fixed a bug where warnings added with a time set to "unset" where
not displayed on export.
- 881:
failure to open temporary file while reading tar SEED data When
importing SEED TAR files now sets the permisions on the un-tared files
to allow reading.
- When importing GCF files, the filename time comparison now only
compares the year and day.
- 880:
very minor bug in error msg from non-existent file channel
- Fixed a bug that did not allow 0 length strings in comma separet
lists. this apllied to -addWarning fileds and other cases.
- Fixed a few minor bugs.
Release 1.2.4 - 2010-06-03
- 828:
Database: Move to transaction based database
The MySql database has been changed to be a Transaction based database
using the InnoDB engine. The Bds API has been updated to support
Transactions and some of the BdsAdminGui's operations have been
modified to use this feature. We have also updated the database to use
the utf8 character set by default.
- 85:
Data per sample access and data block interpolation
- The system now has an option for "Clipping" the output data
so that the start and end times of all of the channels export is the
same. The data blocks of channels that are beyond this period are
truncated to the appropriate sample. The truncation is performed based
on the blocks time stamp and the sample rate in use.
- 496:
WRA_AGSO won There was a bug in the WRA-AGSO file convertor where
the first block was repeated and the last block lost on each channel.
- Modified bdsImportTapeDigitiserData to treat bdsTapeDigitiserFile
processing warnings as warnings not errors.
- 86:
Notes: Add information on TimePeriod, Network, Station, Channel
andSource
- 685:
Add GCF like variable block size data to BdsTest system
- 850:
BdsAdminGui title to reflect connection to server
- 854:
Add BDS Clean API call to clean logs and changes database entries
- 59:
Error and Warning event system
- 665:
Missing block warnings
- Modified
dataType field to support seismic,seismicUnknown,data,unkown and empty.
The bdsImportBlacknestDatabase program now sets these based on the
channelType.
- The bdsImportBlacknestDatabase program did not import calibration
info for channels without sensors. This has now been done.
- 837:
TapeDigitiser import: Add flag to ignore sessions
- 701:
Add support for source names in bdsDataAccess -channel options
bdsImportData and bdsImportTapeDigitiserData now allow the source to be
specified in the -channels flag.
- 700:
Export sample rate information
- 820:
"hang" for horizontal seismos of unknown orientation
- 777:
BdsAdminGui: Improve Channel edit dialog , 522:
Changing channel name loses calibrations/responses.
Many improvements to the Channel editing system. The core difference is
changing a Network/Station/Channel name changes all of the metadata and
sesimic data in the system to match. Note that the channel information
in the sesimic data files is not affected although this is not used
anywhere. As we are now using a transactional database all of the
changes to the channel,calibrations,instruments,responses is only
commited when the "Save" button is pressed.
- 838:
BdsAdminGui: Improve Instrument Sensor and Digitiser entry.
Improved this in line with sugestions from Sheila.
- 77:
Add support for easy import of Meta Data working at Array, Station and
Channel levels
- 768:
Instrument "split at time" when split time is before opening date/time
of instrument metadata
- 694:
Change file URL locations to just specify relative path within the data
store
- Added support for 'M' type data records in SEED files.
- There have been a few parameters added to the /etc/bdsServer.conf
file. It will be worth taking the new version and editing this with the
desired parameters.
- Note that the BDS API has been updated in this
release, so any client applications will need re-compiling.
With this release there are updates to the database Schema to version
7. There
is an additional command "bdsDatabaseUpdate" that should be run after
package update. This will Update the database schema and modify
appropriate entries. So the update process is:
- Shutdown bdsServer: "service bdsServer stop"
- Update the BDS software: "yum update"
- Update the database schema: "bdsDatabaseUpdate -u bdsMain -p
bdsMain"
- Restart the BDS system. "bdsRestart"
The
new release uses a Transactional database. By default the MySQL system
stores all InnoDB database tables in a single file. If desired, the
system can store each table in a separate file. To do this edit the
/etc/my.conf file and add the option "innodb_file_per_table" in the
"[mysqld]" section and restart the mysql daemon with the "service
mysqld restart" command. If this is done before bdsDatabaseUpdate is
run the new transactional database tables will be stored in separate
files. See info in: https://portal.beam.ltd.uk/support/blacknest/info?cmd=infoView&id=828
for more details.
Release 1.2.3 - 2010-05-11
- The bdsImportScream program now uses the import validation
options: "OptionReorder" and "OptionDeleteDuplicates". So any SCREAM
backfilling errors should be handled as best as is possible given the
faulty SCREAM system.
- 700:
Export sample rate information.
The sample rates reported in IMS,BKNAS and SEED files are now the
calculated sample rates rather than the MetaData specified sample
rates. This handles variable sample rate data better, such as
TapeDigitiser data.
- 703:
Save dialog, always defaults to save in ~ FIle dialog now keeps
last uesed directory.
- 708:
"dip" in SEED blockette 52 should be -90 usually for vertical
seismometers. Swaped sign of dip calculation.
- 704:
sensitivity "inf" in SEED files when calib = 0. SEED gain is set to
0.0 if the calibrationFactor is 0.0.
- 724:
Group checkboxes dissappear on View/Append/Modify Fixed bug with
Users group boxes dissappearing.
- 725:
Admin GUI Segfault in Data Files tab
- 726:
Channels selection View/Modify do not work with mutiple selections
- 728:
creating array in AdminGui - added array stations without setting
"type" to "array"
- Fixed a bug in bdsServer in array to station expander. This could
cause no stations to be selected if the first station in the database
was an array.
- 716:
-duration flag doesn't work on bdsDataAccess
- 739:
Station description rendered badly Modified all tables to display
first line of multiline descriptions.
- 747:
BKNAS1 number of channels must be < 32 BKNAS convertor restricts
number of cahnnels to 31 with an error.
- 754:
Changes tab - minor hiding issue
- 755:
Missing control on certain forms
- 763:
Save warning dialog has two buttons
- 769:
bdsDataAccess reports warnings to stdout
- 550:
Problem with multiple Pause/UnPause Fixed.
- 736:
Restricted-length character fields Added name length checking for
Network, Station, ChannelType, ChannelAux and Source fields.
- 784:
"conjugate" pole has zero imaginary part if "return" or "tab" not hit;
window focus
- 783:
wrong "calib" in data exported over mid-block metadata change.
Modified to start next segment on block following MetaData change.
- 781:
Reconecting from Admin GUI after server restart causes bds process to
fail
- 774:
Updating list when new channel is added
- 705:
"#" in station name where otherwise station name = array name
- 671:
Failure to export overlapping data from EKA3566
- bdsImportTapeDigitiserData:
There have been major changes to the
bdsTapeDigitiserFile program used by bdsImportTapeDigitiserData to
re-process the VELA timecode track. This now uses a Phase Locked Loop
algorithm to more accurately set the data block start and end times.
The system now calculates a VelaQuality based on the number of VELA
codes decoded versis the number expected. This is reported as an Import
Warning.
- 770:
Filename of imported data states nearly 8 months Added a check to
make sure the date range is less than 10 days in one import file.
- 804:
Output SEED data have duplicate blocks at end
- 805:
BDS SEED files in "Jrdseed" Now outputs channels in Station order
with a single blockette 50 per station.
- Source names are now validated and BdsAdminGui uses comboboxes
for the available source names.
- 810:
bdsImportData with -dryRun does not issue "data already present" error
Added checkif if data is present when -dryRun is used.
- 808:
Dummy channels
Added support for a channel "noMetaData" boolean. When this set on a
channel it states that there is no MetaData present (Calibrations,
Responses, Instruments). When set data can be imported, with a warning,
however date export of the appropriate channels is not possible as an
error of missing MetaData is given.
- 79:
Add meta data validation checks.
- 733:
Add -startTime and -endTime options to bdsImportData
It is now possible to use -startTime and -endTime options with the
bdsDataImport program to imports time spans of data from files.
- 690:
default source "Main" for Responses
- 823:
GCF files: Filename time errors when hour is not 0
- 456:
Certain windows/dialogues incompatible with 1024x768 resolution
- 825:
BDS server behaviour under load This has been fixed.
- 835:
Channel DataType field This has been added.
- Note that the BDS API has been updated in this release, so any
client applications will need re-compiling.
With this release there are updates to the database Schema to version
6. There
is an additional command "bdsDatabaseUpdate" that should be run after
package update. This will Update the database schema and modify
appropriate entries. So the update process is:
- Shutdown bdsServer: "service bdsServer stop"
- Update the BDS software: "yum update"
- Update the database schema: "bdsDatabaseUpdate -u bdsMain -p
bdsMain"
- Restart the BDS system. "bdsRestart"
Release 1.2.2 - 2010-03-16
- Minor change to BdsImportBlacknestDatabase to modify MetaData
source allocation to use new EkaDig2 scheme. Set database initial
source data to use "EkaDig2" rather than "Scream".
- Now handles MetaData for EKA:SHZ around GCF24EKA0811 better by
merging MetaData either side for the source Main.
- Extends the EKA:SHZ:Main and EKA_BHZ_10 data to end of time.
- Extends the EKA:SHZ:EkaDig2 to cover all time
- Improved Sensor selection algorithm to share sensors for channels
better.
- 695:
preicision of longitude for WRA and YKA
- Extended bdsImportScream to support source names in configuration
file on a per import source basis and modified default to use a source
of "Main".
Release 1.2.1 - 2010-03-12
This is a minor update, fixing some small bugs found in the 1.2.0
release.
- BdsAdminGui: Fixed bug with data viewer where missing block data
at the very start and very end was not highlighted as missing.
- SEED blockette MetaData is now stored in infoExtra to reduce
normal data info clutter.
- BdsAdminGui: Added Splitter bar to DataSelect tab.
- BdsAdminGui: Fixed bug in DataFiles window where selected
channels where not viewed correctly when a File was selected.
- BdsAdminGui: Changed default filename format used for downloads.
- BdsAdminGui: Added scroll bars to DataSelect warnings dialog.
- BdsImportBlacknestDatabase: Modified to ignore "SCREAM.*" format
channels on import and extend MetaData endTimw's for EKA to be end of
time.
- 657:
Exporting EKA BB data with gaps: (ChannelInfo not matching actual data
blocks) partially fixed.
- 658:
wrong number of samples in IMS format data originally GCF from EKA BB
array
- 673:
SEED reader "unknown block type: R" Added support for 'R' and 'Q'
SEED data blocks and type ' ' padding blocks.
- 668:
AdminGui DataSelect output file navigator GUI error
- 670:
"Update Select Fields" button in DataSelect window resets times
- 669:
output data file is not completed until a warning popup is "OK"d/closed
- Added endTime to ASCII format MetaData.
- BdsAdminGui: Improved DataSelect and display to keep
segementation of data rather than create multiple channels of data.
- 690:
default source "Main" for Responses
- Validates user entered time in Respose,Calibration and Instrument
"split" operations.
Release 1.2.0 - 2010-03-01
This is a major update to the system, fixing and changing some of the
core internal structure.
- Changes to BDS data file format. This adds channel and segment
info to the data blocks to improve the performance of dealing with
segments of data when there are missing blocks or in other
multi-segmented data applications. Also improved block searching
performance and other minor improvements.
- Major changes to the DataSet class. This is responsibe for
gathering the data from multiple channels of multiple segments in
multiple files and providing access top the seismic data conatined.
This will have fixed many issues with data access.
- 89:
Automatically break data into segments when there are missing blocks
- 526:
DataAccess wild card matching not supported
- 498:
non-synchronously sampled" error when exporting (non-multiplexed) ASCII
data over a file boundary
- 84:
Improved operation when there are multiple segments of data
- 330:
Break data into segments on MetaData changes
- 303:
Automatically break data into segments when there are metadata changes
- 498:
"non-synchronously sampled" error when exporting (non-multiplexed)
ASCII data over a file boundary
- Modified the ASCII data format to support Channel Multiplexed:
ASCII-CM and Sample Multiplexed: ASCII-SM formats and multiple
segments. Multiple segments are implemented by adding a comment line
starting with a "#" with channel, segment, time and other information.
- 338:
failure to export EKA Red line
- 404:
tapeDigitiser data import: Delete multiple FM deviation errors.
Added InfoExtra storage in BDS data file format in in BDS API to store
the extra TapeDigitiser error information. This speeds up data access
but still allows full storage of the contents of a TapeDigitiser data
file.
- 385:
TapeDigitiser import fails when there is an "empty" data file
- 371:
TapeDigitiser import failing for lack of metadata
- 336:
TapeDigitiser data with huge numbers of errors
- 597:
Add Calibrations name field
- 513:
Metadata overlap error message when modifying "response" information
- 588:
poles/zeros in output SEED files read by rdseed
The system now uses base SI units of all data and uses
calibrationFactors that will convert the data samples to the base SI
units in question. When exporting in a particular data format
unit/scaling conversion is done as appropriate.
- 507:
BKNAS format when many poles/zeros
- Fixed crash in BdsServer when trying to export SEED-MINI data.
- Fixed problem with SEED sensitivity value.
- Changed SEED dip angle and gain calculations. Set Stage Number to
0.
- Changes units operation.
- Fixed problem with dataImport continuing when SEED data format
errors were present.
- 634:
Add support for SEED-METADATA file format
- Modifications to BdsTest system to help test the above changes.
- 432:
Login window disappears after one failed attempt
- 433:
TCP reset requires to have to be restarted, Access Denied error
- 488:
DataFiles tab shows meaningless import data
- 537:
File channel metadata editing
- 425:
DataSelect tab multi select
- 427:
bdsAdminGui dataselect->dataview usability issues
- 497:
"Update" button on channels window didn't work
- 430:
DataView channel shift, 431:
DataView seems not to work when displaying multiple channels
A simplified DataView tab has been implemented. This allows the viewing
of multiple data channels with multiple data segments, possibly
overlapping as well as channels at differeing sample rates. It has a
simple autoscaling function.
- 647:
default file name formation fails when station name includes #
- Numerous higher level MetaData editing functions added to
"Options" menus.
- BdsImportBlacknestDatabase: Added support for importing Pseudo
stations.
- Removed SensorLocations table and added depth and sensor angles
to Calibrations.
- Note that the BDS API has been updated in this release, so any
client applications will need re-compiling.
- Note that the BDS data file format has changed and, for
simplicity at this stage of development, no compatibility with the
previous file format has been provided. So all data files will need to
be re-imported.
With this release there are updates to the database Schema to version
5. There
is an additional command "bdsDatabaseUpdate" that should be run after
package update. This will Update the database schema and modify
appropriate entries. So the update process is:
Shutdown bdsServer: "service bdsServer stop"
Update the BDS software: "yum update"
Update the database schema: "bdsDatabaseUpdate -u bdsMain -p bdsMain"
Restart the BDS system. "bdsRestart"
Release 1.1.9 - 2010-01-26
- Changed default import data source to "Main" from "Master".
- System now sets importUserId and importTime fields in DataFiles
information.
- Preliminary SEED data file import.
- BdsImportData: added "-sequential" flag. When used it will import
the given set of files sequentially into a single import file. This is
especially usefull for SEED-TAR format files. The files have to contain
the same channels in the same order and be completely sequential in
time.
- 570:
SEED Export converter. The system can now export data in SEED 2.4
and SEED-MINI 2.4 formats.
- DataSelections invovling an array in combination with a set of
individual stations did not work correctly. This has been fixed.
- Data selections within a single file that contained
non-synchronously sampled data at different sample rates did not work
corectly. This has been fixed.
- Added -formatList option to bdsImportData.
- 428:
bdsAdminGui long processes need hourglass cursor
- 104:
Add ability to manipulate Sensor Data information and delete sensor
data files
- 405:
New Data files window - various
- 523:
Delete data files.
System now deletes data files by moving them to a directory "Deleted"
on the store in question. These will need to be actually deleted at a
later date by an operator.
- 350:
Improve data access performance by elimimanting second getInfo
- 27:
default filename in GUI
- 417:
Time date widget defaults to 2002
- 424:
DataSelect tab usability issues
- Changed
DataSelection system in bdsAdminGui. Now provides wildcard filter on
each item and multi-selection restricted to database entries. Note that
selection restriction for data ignores the time fields. This is for
performance reasons. It would be possible to implement a cache of
distinct, time based, channel information to allow selection
restrictions based on actual data time periods if required.
- Changes to use "*" wild carding system in bdsDataAccess and
bdsAdminGui.
- System now checks the "state" parameter on data files before
serning the data.
- Added ability to list default file format extensions.
- Added BdsDataFormats manual and updated other manuals and
documents.
- A few minor bugs have been fixed.
- Note that the BDS API has been updated in this release, so any
client applications will need re-compiling.
With this release there are updates to the database Schema. There
is an additional command "bdsDatabaseUpdate" that should be run after
package update. This will Update the database schema and modify
appropriate entries. So the update process is:
Shutdown bdsServer: "service bdsServer stop"
Update the BDS software: "yum update"
Update the database schema: "bdsDatabaseUpdate -u bdsMain -p bdsMain"
Restart the BDS system. "bdsRestart"
Release 1.1.8 - 2009-12-14
This is an interim bug release version. The BDS API has changed so that
any client machines will need to be updated as well.
This release is now built on Red Hat Enterprise Linux 5.4 and has a new
yum repository. The repository change will be automatic, but two yum
updates are required, one to update the repository info and one to
actually perform the update.
- 455: Window
hiding issue on certain window managers
- 464: DataViewInfo
DataViewChans inconsistent inital state
- 465: UserInfo
tab, User Edit dialog group selection disappears
- 461: Dialogue
window on Changes tab list
- 411: BdsAdminGui:
Update selection lists in channel on updates
- 414: Database
does not keep up with station/channel name change
- 474: Number
of channels incorrectly calculated?
- 475: Wrong
hang & vang
- Added "datum" import from Autodrm database in
bdsImportBlacknestDatabase.
- Removed wild card from stations in Autodrm.
- 416: System
puts all data files in a single directory Note that this does not
update the location of any existing files imported into the BDS system.
- 401: Change
source "Default" to "Prioritised"
- 460: Inconsistent
list behaviour with modify
- 494: BDS
fills /tmp
- 495: bdsControl
exectuable missing from rpms
- 511: BKNAS
instrument number
- 508: BKNAS
format 1st line of Channel description
- 501: precision
of "calib" for BKNI data Note that this bug affeced MetaData
imports so values in the BDS SQL database for calibrationFactor could
be wrong.
- 355:
Add a test Array/Stations/Channels for performing automatic regression
tests The first pass system has been created. This just creates
BDRS files at the moment but export tests are generic.
- Added the "NETWORK" keyword to the BdsAutodrm. This allows the
network to be set for test puposes.
- 492:
StationLocation selection in Stations needs Network This has been
added.
- 453:
BDS AutoDRM acts as a relay
The system now ignores emails from users not registered in the BDS
users database. It checks the "ReturnPath" and "From" field headers for
the users email address. Errors are looged into the syslog of the
bdsAutodrm daemon's host.
- 514:
Interrupted data import results in bad data status. This has been
fixed.
- 525:
DataAccess error message Error text changed.
- 402:
Data import error/warning message improvement Warnings are now
presented as a comma separated list.
- 403:
BdsImportData: Add "-info" flag. Added -description and -addWarning
flags to system. See the documentation in https://portal.beam.ltd.uk/support/blacknest/files/bds/doc/BdsImport.pdf
for more information on the formats of the warning messages.
- 545:
bdsImportTapeDigitiserData. Added ability to read jobInfo.tdim if
it exists instead of jobInfo.tdi.
- Added import warnings when blocks are re-ordered. The warning
includes a description of the block re-ordering performed in the form
of an ASCII string. The format of this string is a list of block ranges
and the re-ordered position. For example "0-10:30" means blocks 0
through 10 have been moved to position 30.
- Added the Blacknest-testing yum repository for test updates. This
is not enabled by default.
Release 1.1.7 - 2009-10-02
- Added support for setting source names from format in
bdsImportBlacknestDatabase program.
- Fixed a bug where the source field was not being used to validate
the addition of new ChannelInstruments.
Release 1.1.6 - 2009-09-25
- Fixed crash on DataFile deletions.
- 282:
multi-multiplexed data in channels 19 and 20 of BDRS_UKNET data
Added support for BDRS-MM data files.
Release 1.1.5 - 2009-09-25
- 381:
BOAP connects to localhost. This has been fixed
- 367:
BDRS UKNET 10-Hz data import Added support for BDRS files with 10Hz
sampling rate.
Release 1.1.4 - 2009-09-16
- 338: CalibrationUnits now set from channel name.
- 389:
BKNAS-1 output calibration factor is written where pole-zero constant
should be Now calculates the PoleZero constant for the PoleZero
output in BKNAS format from the PoleZero table.
- 385:
TapeDigitiser import fails when there is an "empty" data file Added
support for zero data length TapeDigitiser files.
- 390:
EKA BB GCF corrupt data This has been fixed.
- Added, first pass, DataFile and DataChannel API functions and
editing ability.
Release 1.1.3 - 2009-09-08
- Removed debug print from bdsImportData with sample multiplexed
file import.
Release 1.1.2 - 2009-09-07
Release 1.1.1 - 2009-08-17
- 341:
WRA_AGSO alias in bdsImportData "-format" option. This has been
added.
- 343:
MaxNumSamples in bdsServer.conf. Changed to 1024 by default.
- Fixed a bug in calculating the number of datasamples/sample rate
in a set of data.
- 342:
"sample rate incorrect" for WRA40 and WRA_AGSO data There was a bug
in the WRA-AGSO sample rate calculation routine when crossing a year
boundary, This has been fixed.
- 340:
Add -listFormats option to bdsDataAccess and use in bdsAdminGui
- There was a bug that caused data import to fail with the error
"Unknown output format:" this has been fixed.
Release 1.1.0 - 2009-08-06
- 57: Added snapshotPause call. The API function takes a boolean
argument, on or off to set the BdsServer into pause mode for backup
puposes. See the BdsServer manual for more information.
- 57: Added the modeSet API call. This allows the BdsServer to be
put
into a read-only slave mode. See the BdsServer manual for more
information.
- 57: Added the security group "control". The snapshotPause and
modeSet
calls require the user to belong to this group.
- 57: Adde the user "bdsBackup" for backup purposes. This user
belongs
to the control group but has no other abilities.
- 57: Added "state" field to DataFiles table to indicate the data
files
state. This can be set to "importing" or "ok" and can be used for data
synchronisation puposes.
- 270: Added the "Config" tabale to the database to contain
configuration parameters. One configuration parameters, "schemaVersion"
has been added to this to track the BDS MySQL data base schema version.
This allows for automated database schema updates on software updates.
Add the command line program bdsDatabaseUpdate command to update the
ruuning database's schema to the current version.
- 253: Change the BdsServer's database user to "bdsMain" and set
the
older "bds" user for read-only access. This allows external programs to
read the BDS's database safely. The database grant's need to be updated
with the following commands for this to work and the
/etc/bdsServer.conf file needs modification.
grant all on BDS.* to bdsMain@"%" identified by "bdsMain";
grant all on BDS.* to bdsMain@"localhost" identified by "bdsMain";
grant select on BDS.* to bds@"%" identified by "bds";
grant select on BDS.* to bds@"localhost" identified by "bds";
- 268: Added support for re-ordering data blocks and deleting
duplicate data blocks on import. The "-reorder" and "-deleteDuplicate"
flags have been aded to bdsDataImport for this. Currently only the GCF
format convertor supports these options, but they can be added to each
or all data convertors relatively easily if required.
- Fixed:
278: cannot add new SensorLocation without saving-and-reentering
- Fixed:
264: AdminGui update bug in DataSelect window
- Fixed:
283: extracting "filename time" from EKA SCREAM data files
- Fixed:
289: AdminGui bug for a particular GCF file - "QG Vector::insert: index
xx out of range"
- Fixed:
291: BKNAS1 format
- Fixed:
306: AdminGui editing channel responses
- Fixed:
265: No. of samples in 2nd segment of 2-segment IMS exported file
- Fixed:
286: sampling rate for EKA GCF data
- Fixed:
210: TapeDigitiser import two-tape sets
- 311:
On importing TapeDigitiser files keep original file name The
BdsImportTapeDigitiserData program now lists the actual file import in
the Description field.
- 325:
Fixed: Database description entries should allow the "' " character
- 336:
TapeDigitiser data with huge numbers of errors
We have improved the perormance of the BDictString class to help this.
Howvere the number of errors produced by the tapeDigitisation process
needs to be looked at.
- Added support for Station Aliases. These can be used to rename
the pusedo stations used for extra data channels that are not
associated with any physical stration, to the Array name as well as for
other puposes. The Aliases are only normally used in data output
formats.
- Added support for MetaData sources that match the data sources.
This allows different MetaData parameters to be attached to different
data sources.
- Added support for Source Priority to decide which data Source to
select if a data source of "Default" is used.
- General bug fixing.
- Modified bdsImportBlacknestDatabase to suit more recent Blacknest
Autodrm database schema.
With this release there are updates to the database Schema. There
is an additional command "bdsDatabaseUpdate" that should be run after
package update. This will Update the database schema and modify
appropriate entries. So the update process is:
- Shutdown bdsServer: "service bdsServer stop"
- Update the BDS software: "yum update"
- Update database users: "mysql -uroot -p<root-password> <
/usr/bds/bdsSql/permissionsFix.sql" (Special fix to database user names)
- Update the database schema: "bdsDatabaseUpdate -u bdsMain -p
bdsMain"
- Restart the BDS system. "bdsRestart"
Release 1.0.7 - 2009-06-03
- BDRS data converter: Added support for reading files with
corrupted first block and some other data validation improvements.
Release 1.0.6 - 2009-06-01
- 215,220,225,229: VELA timecode track, end of year problem. If a
new tape was started when the VELA time code generator had gone beyond
the end of the previous year, the year would be decoded incorrectly.
This has been fixed.
- Added data converters for WRA-40, WRA-64 and WRA-AGSO data
formats.
- Added "-ignoreCorruptions" option to BdsImportData program to
fix data files by ignoring corrupted blocks. The data converters will
scan for the next valid block when an invalid block is found on a byte
by byte basis.
- Added "-dryRun" option to BdsImportData program to perform import
test without actually importing the data.
- BdsImportData now as a "-warnings" flag which will list the data
import warnings. The warnings are also added to the BDS MetaData for
the data file so that they can be investigated at a later date.
- Various data import validation improvements.
Release 1.0.5 - 2009-04-02
Minor bug fixes:
- 212:
BDS Instrument name Metadata issue. This was a bug in the BDS server
when there were multiple instruments used on a
channel at different time periods. The system was choosing the first
entry rather than the one for the time period in question.
- 217: BdsAdminGui:
Adding new stations problem
- Added the utility program bdsDataFileCreate. This program
can create test sensor data files in any of the formats supported by
the BDS system with write data convertors.
- Added the ability for bdsImportData to import sensor data files
in the BDS format.
- Made boapns daemon run as the daemon user by default.
Release 1.0.4 - 2009-03-27
Minor bug fixes:
- Bug in BdsImportData when ignoring missing data blocks. This
would cause a segment fault.
- 195: Fix to TapeDigitiser import. VELA timecode track, end of
year problem. This problem was
caused by problems in the VELA timecode track near the year end on tape
EKA 3616.There was some curruption in the VELA timecode track and then
a
missing bit of VELA time code followed by and incorrect year wrap. The
software could not cope with this unusual circumstance. We have added
some code to handle this case.
- Added Channel Aux field to BKNAS channel output lines based on
Sheilas BKNAS modification.
- Modified BdsAutodrm so that all channel names have the ".*"
postfix added so that channel types given will match all channel names
of that type irrelevent of the AuxId.
Release 1.0.3 - 2009-03-23
Minor bug fixes:
- 158:
End of day/End of year crossing time stamp errors in
formatted data output. The time stamps listed in the data output where
set to the user requested time not the actual data times from the
blocks. This has been fixed.
- 187:
Problem with bdsImportTapeDigitiserData validating meta data. This has
been fixed.
Release 1.0.2 - 2009-03-16
Minor bug fixes:
- Fixed bdsImportScream file handle leak.
- Fixed bdsImportTapedigitiserData to find supporting programs in
standard path.
- Improved Pole/Zero editor.
Release 1.0.1 - 2009-03-10
Minor bug fixes.
Release 1.0.0 - 2009-03-04
This is the first release of the BDS software.