
- #Ford as built data file download manual#
- #Ford as built data file download full#
- #Ford as built data file download download#
The identical (small) file sizes involved. #Ford as built data file download manual#
Manual inspection of several small files. As indicated above, we assume that any files smaller than this value have no observations. In this section we analyse the data files that have a file size > 3000 bytes and which have been used to create the safe data. Following detailed checks there are now 0 files which are still labelled as having ambiguous dates. If you re-use the data outside New Zealand you will need to set the timezone accordingly or you will get thoroughly confused. Note that R will load UTC data with the local timezone so if you re-use the data in New Zealand this will be correct. There are a range of dateTme formats - these are fixed in the data cleaning process and all datesTimes have been set to UTC except where explicitly labelled. The non-loaded files only have 2 distinct file sizes, confirming that they are unlikely to contain useful data. Unknown - ignore as fsize ( 43 ) < dataThreshold ( 3000 ) Unknown - ignore as fsize ( 2751 ) < dataThreshold ( 3000 ) Table 3.3: Number of files & min/max dates (as char) with given date column names by final imputed date format Ymd - default (but day/month value <= 12)Īfter final cleaning, the final date formats are shown in Table 3.3. Kable_styling() Table 3.2: First 10 (max) of 3957 files with dateColName = ‘date UTC’ and default dateFormat Kable_styling() Table 3.1: First 10 (max) of 12 files with dateColName = ‘date NZ’ and default dateFormat Table 3.1 lists up to 10 of the ‘date NZ’ files which are set by default - do they look OK to assume the default dateFormat? Compare the file names with the dateExample… # list default files with NZ time A key lesson for future projects is always to ensure that files are named so that meta data is easily parsed and that there can be one and only one: Resolving and cleaning these variations and uncertainties have required substantial effort and in some cases the date format (and thus time when timezones are set) has had to be inferred from the file names. In this case the origial dateTime of the observation was stored as UTC. In this case the dateTime of the observation appears to have been stored in NZ time and appears also to have varying dateTime formats (d/m/y, y/m/d and even in some cases the inexplicable m/d/y) #Ford as built data file download download#
Manual download of large samples of data. The original input data does not therefore distinguish between these households and we discuss how this is resolved in the clean safe data in Section 4.1 below.Īs noted above, the original data was downloaded in two ways: The GridSpy IDs (rf_XX) remained unchanged despite allocation to different households.
In addition two of the GridSpy units were re-used in new households following withdrawal of the original participants. We therefore flag these files as ‘to be ignored’. However a large number of files (14,929 or 59%) have 1 of two file sizes (43 or 2751 bytes) and we have determined that they contain no data as the monitoring devices have either been removed (households have moved or withdrawn from the study) or data transfer has failed. To date we have 25,148 files from 44 unique GridSpy IDs.
The original data files files are stored on the University of Otago’s High-Capacity Central File Storage HCS.ĭata collection is ongoing and this section reports on the availability of data files collected up to the time at which the most recent safe file was created ( 18:03:19).
#Ford as built data file download full#
#YMMVįor the avoidance of doubt and explanation of terms please refer to the full license notice and legal code. For example, other rights such as publicity, privacy, or moral rights may limit how you use the material. The license may not give you all of the permissions necessary for your intended use.
You do not have to comply with the license for elements of the material in the public domain or where your use is permitted by an applicable exception or limitation. No additional restrictions - You may not apply legal terms or technological measures that legally restrict others from doing anything the license permits. ShareAlike - If you remix, transform, or build upon the material, you must distribute your contributions under the same license as the original. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use. Attribution - You must give appropriate credit, provide a link to the license, and indicate if changes were made.
Adapt - remix, transform, and build upon the material for any purpose, even commercially. Share - copy and redistribute the material in any medium or format. This work is made available under the Creative Commons Attribution-ShareAlike 4.0 International (CC BY-SA 4.0) License.