New Export / HTR2001

[Ken Massa]

Newest export is ready in HTR2001. Click the Export button to access the export interface.

First - get the latest copy of HTR2001.EXE and run the Export screen.

Second - read the text file spec for the export: HX1.TXT

Third - read my post on the General forum about the new data.

For a first edition of the HTR2001 export, I didn't want to get too elaborate or have a plethora of data fields. I have designated the first 22 fields as "standard" for all future editions of the export. Each edition will be identified by HXn, this first one is HX1. The HXn is used in the file naming to identify each file. Paceline mode has been streamlined and can now be used as query item because all modes can be exported to the same file (and fast!).

A key element of the data in these exports is to use Integer values to make query runs simple and extra easy to set up. Also encoded are additional 1,2,3 flag fields that help make the query process a breeze. For example, the nDS field has 4 values. 1=if the race is a dirt sprint; 2=dirt route; 3=turf sprint; 4= turf route. While you could query by individual distance and surface, many times you just want a general look at the data. So instead of nDist < 8 and nSurf = 1 (dirt sprint) just use nDS = 1.

While I can check for the accuracy of the data and the basic functionality on my own, it takes many users doing a million different exports to find obscure bugs. So to motivate everyone to beta-test, I put in several new and interesting items to go along with our old standbys. Many of these have never been used before, such a "GL8" or "QT3". And this version has just 42 data fields, a nice clean package but plenty to do.

No trainer/jockey/breeding stats in this version. They will be a separate entity next. But the first 22 fields will be exactly the same in all editions.

Please let me know if you find any problems. And hopefully we can get some interesting posts here regarding your findings.

[Rick]

The new upgrade of HTR2001.exe and the text file HX1.txt are posted at

http://www.homebased2.com/km/htr3.htm

[MikeDee]

Ken, First question on the new export. I plan on rebuilding my data base by taking my old htr files and exporting to access with the new exporter.

My data files go back to march of 99. Do you see any problems with using the exporter with files from 99 and or 2000?

[Rick]

I ran into trouble running the exported in WinXP.

I still have to run some tests, but the exported seems to quit when I try to multiple task. I am running 384 mb of ram.

Try it under your version of Windows and let us know your experience.

If the exporter stops running on you, try running by itself.

[Bernie]

Ken,

There are some wonderful new fields in this export, such as nQpc, nGL8, nHAG, and xPL. However, my spot plays use fields from Impact and MSA, and I sure don't wan't to try linking all 3 tables together and doing 3 different exports every day. Will the new export ever include all the fields from the other 2 tables? I hope so. I wouldn't mind rebuilding my Db if and when it does happen.

[MikeDee]

Rick, I am not having a problem multi-tasking under win 98 and I only have 64meg of ram. I am exporting as I write this post and the exporter is proceeding fine.

Ken
I have exported all of my AQU files for 1999, 2000 and 2001 no problems 100% compatiable with other exports of msac and impact.

Questions.

I noticed that "nLDR" early lead flag uses 1 and -1 in HTX while nLDR is 1 and 0 in impact. Is 1 and -1 going to be the standard conventions for this field?

Do you have a time estimate on how long it will take to add all the fields to HTX that you plan to include?

Are the pace calculations in HTX more exact then in htrmsa?

I believe you stated that you could not combine the 2 exports of htr and impact because of size limiations. Is this correct and we will continue to have 2 exports one for HTX and another for impact?

Is Pace line 4 in the HTX the same as pace line 4 in HTR2001?


Suggestion

My initial thinking is that I don't want to import all 5 pace lines because this will increase my db by a factor of 5. But I would like to import 1, 4 and 5 ( I think). Could you modify the export to put multiple bullets in the pace line selection field to select more then one but less then all 5?

[hurrikane]

Ken,
I went and exported all tracks for Nov 10 thru Nov 19th. All pacelines..to an allfile. When I imported the data into access Nov 12,13 and 19 weren't in the file. Went back and ran it again, checked to be sure the data was there and watched the export and it seemed to pass over these dates. Maybe too many files?

Haven't check others but will let you know what I find.

Ok...I see what's happening now. If you select export to an additional all file it only exports the one track on the list unless you select export all files on list.

Would it be possible to export just the All_hx1 file and not all of the individual files the same way impact gives you that option.

Also...think we could do away with the redundant "Hello" sign. It's nice talking to you..but not every time a track exports. :D

[Carl]

Sounds exciting AND scarey.

Think I'll "let Mikey try it" for a few more days first hehe.

And I am happy with what I've got........

[Ken Massa]

I'll try to answer all questions in mass here.......thanks for the feedback and suggestions!

I'll add a ALL-only button this weekend and send to Rick.
Any other bugs reported in the next 24 hours I will fix also.

As for checkboxes for individual paceline modes. The output files are in the "append" mode, so change the PL and re-run the same data to add more PL's to your file. It would be complicted and time consuming to code flexibility on that. I would only use the multiple PL approach with smaller samples of a single track anyway - as Mike suggested, you increase your file size too much. But it could make for an interesting query to check the strength or weakness of each mode.

Paceline mode 4 in HTR2001 is an entirely different concept than DOS version (read Nov newsletter). This data was not really meant to be linked to HTR4MSA. Carl has the right idea - don't mix apples and oranges unless you really know what you are doing! But MikeDee does, so he will probably find the secret to beating the races while combining it all. With brand new concepts involved, it is probably wise to keep a separate db for now.

HTR2001 has tighter controls on the pace and velocity computations is slightly more accurate. I am standardizing the data in HTR2001 for future export projects and will eventually have all the data from 'MSA involved. I'll have a new export each month or so and the next one involves the trainer/jockey/pedigree/horse stats. Then Impact data and speed figures after that. All future HX will use the same data field names and the first 22 fields will match every time. This will make it a breeze to link em later. Charts data will be added later.

I'll check that flag for nLDR = -1 should be a 0. The (*) is a different concept from DOS version as well. You may find more than one in a race, you may get none.

Use data from October 1999 and later only. The previous files did not contain all the information that Jim Cramer provides now until that date. Same goes for the Impact exporter.

My tests with exporting 46,000 racefiles were great in Win98 and ME. But froze in XP, similar to Rick. Another reason not to upgrade? I think additional RAM would solve the problem though, the issue of freezes or crashes when exporting the data is a resource problem in XP, not an overload from the HTR2001.

[Rick]

There is a new HX1.txt file up at http://www.homebased2.com/km/htr3.htm

Chuck noticed that the nPPO field was missing.

Thanks Chuck.

[Ken Massa]

I'm shipping Rick a Dec 15 version of the HTR2001 that adds "export to ALL file only" checkbox replacing the previous. This saves the data to the ALL file only and does not create separate track files.

By combining that "ALL file" checkbox and the "export all tracks" checkbox - it will be a one step operation to send everything into one file without creating a million additional individual track files.

Using that feature in Windows98 and ME went smooth and easy on a huge sample. XP finished it ok, but seemed to stop and think at times - pausing, but then carried on. But the screen display would freeze even though it was still processing the files. Rick had the same experience. XP has some molasses in there.

[Rick]

The new (15 Dec 01) upgrade of HTR2001.exe and HX1.txt are up at

http://www.homebased2.com/km/htr3.htm