PDA

View Full Version : Who uses Excel?


Dave Schwartz
01-13-2003, 09:10 PM
I am curious about how many Excel users are in our group.


1. I use Excel 97 or newer

2. I have Excel 97 or newer but do not use it.

3. I use another spreadsheet program.

4. I don't use spreadsheets.

5. What's a spreadsheet?

cj
01-14-2003, 08:13 AM
Dave,

Do you mean in general or for horse racing purposes?

CJ

Dave Schwartz
01-14-2003, 03:01 PM
CJ,

Well, I actually mean "in general."

I can't expect many people to use it for horse racing purposes because there just aren't a lot of learning aids to show people how.

I am sure you can see where I am going with this.

Dave

kitts
01-14-2003, 03:31 PM
Dave-
I cannot see where you are going with this. I have MS Office 2000 with Access which is major overkill. I had always sort of hoped that I would use Access and/or Excel for horseracing but, as you point out, there are not a lot of learning aids for that. But, if there were...........

Dave Schwartz
01-14-2003, 04:21 PM
Kitts,

Well, I am considering building handicapping tools for Excel. Much more than this I am not prepared to say, but imagine that if one could easily get the data into Excel, one would have the kind of control over it that many of us have always wanted without needing a guy like me to spend two years on software.

Dave

kitts
01-14-2003, 04:33 PM
Dave-
I wish you the best on this probability and should software result, put me down as the first customer.

cj
01-14-2003, 04:51 PM
Dave,

Let me know if you need any help with anything in Excel. I believe I sent you the one I made for your Horse Market Investing work, so you see if have some idea of how to use it.

CJ

Derek2U
01-14-2003, 05:16 PM
you can DL data from formulator then export to excel. I'm just
getting ready to finally start getting a DB to test an idea or two.
But I think it would be smart not to capture every data but
try & be selective. hehe theres gonna be a lotta data coming at ya.

anotherdave
01-14-2003, 05:26 PM
Originally posted by Dave Schwartz
Kitts,

Well, I am considering building handicapping tools for Excel. Much more than this I am not prepared to say, but imagine that if one could easily get the data into Excel, one would have the kind of control over it that many of us have always wanted without needing a guy like me to spend two years on software.

Dave

Sounds like a very good idea!

AD

Kappa
01-14-2003, 06:27 PM
Dave

I DEMAND to see screen shots and a website with examples ...NOW!! :D

Kappa
01-14-2003, 06:30 PM
Sorry,

With all that's been going on, I couldn't resist. ;)

Dave Schwartz
01-14-2003, 07:53 PM
Kappa,

You know, I've got a bunch of users just like you. <G>

Dave

modred
01-14-2003, 08:17 PM
I voted no, but I thought it was for horseracing ... I use it extensively at work ...mainly for statistical calculations.

The last time I thought about dragging the Bris file into it I found it didn't have enough columns. I mean it will get part of the Bris file into it but not all. Maybe if someone could make something with VB using the Jet DB engine in that and then possibly it could be faked into looking like there were enough columns ... just thinking .. I know .. it's dangerous

rcj
01-15-2003, 03:50 PM
Modred,
You can download a free program from BRIS called INFOTRAN. It lets you select the data items you want from the BRIS data files and produce a comma-delimited file which can easily be loaded into Excel. You can even use it on the 50 cent TSN files.

Larry Hamilton
01-15-2003, 05:46 PM
in fact it works for both Access and Excel, and it works for both TSN and BRIS..so you could get in for 60 bucks. It MAY even work on any comma delimited text file, though I havent tried others..

Tom
01-15-2003, 09:03 PM
Track Tout put out a program that extracted certain field from either TSN or BRIS data files. The link I used to download it no longer works, but I'll attach the file output file structure and their address is at the end of it.

Zaf
01-15-2003, 09:26 PM
I think there's a handicapping program called Rexpoint ? I think thats the name. It runs on excell. I have never used it.

ZAFONIC

Speed Figure
01-15-2003, 09:55 PM
I think Rexpointe is a manual entry program that uses the DRF.

modred
01-15-2003, 11:28 PM
Thanks rcj

I downloaded the file from Bris .. now to see what I can do with it.

Larry Hamilton
01-17-2003, 11:28 AM
Guys,
Excel is 255 cells wide (these are called FIELDS). INFOTRAN will parse the incoming text data which concists of nearly a thousand fields. You cannot have all the fields on one spreadsheet--they dont fit! That is why many of us are not putting the data in Excel, rather we put it in Access and ship to Excel bits to analyze.

Richard
01-20-2003, 08:49 PM
Dave'
I too would be very interested in any handicapping tools for Excel that you might develope.Would you be kind enough to keep us posted if and when you do?

Dave Schwartz
01-20-2003, 09:26 PM
Oh, but that might be construed as "selling. <G>

Of course, I will. <G>

Dave

lueylump
01-21-2003, 12:17 AM
I use the Sartin Multi-Track Synthesis program in my handicapping, and Excel is integral to the process!

Unfortunately there is no way of exporting data from the program, so I hand enter about 30 factors or rankings into an Excel spreadsheet I created. Once there I have another worksheet that summarizes that data and provides valuable information like winning percentage, average mutuel, Expected Value, and ROI. This information is segregated by surface and type of race (i.e., sprint or route). Consequently I know which factors are profitable by surface and type of race for a given track.

Without Excel to synthesize this information, my handicapping would just be a shot in the dark!

Dave Schwartz
01-21-2003, 01:20 AM
Luey,

There is always a way to caprutre the data... even if a little cludgy.

There is a program call SnagIt, a screen capture utility, that can capture most screens and turn it into text. Then you can paste it "somewhere.

Here is a link, if you are interested.

http://www.techsmith.com/products/snagit/default.asp

Regards,
Dave Schwartz

lueylump
01-21-2003, 06:09 AM
Thanks Dave,

I will give it a try!

Lueylump

tanda
01-25-2003, 01:58 PM
I import PPs into an Excel procedure that I coded. It processes the data as I specify and then, as part of an automated betting procedure, it places the wagers. So, I use it for both data analysis and automated wagering. The automation process uses automation software in conjunction with Excel.

MikeH
01-29-2003, 05:29 PM
Dave -

I have been working in Lotus since it first came out. After using Allways, HTRF, and AOdds, I finally downloaded Infotran and wrote my own protocol to import into Lotus. I find that the older Macro language in Lotus is much easier for non-progammers to use. My model imports both the $1 Bris files, as well as the charts that I download through the "Chartget" program that was so kindly made available here (I forget by who... sorry.)

I wrote a number of formulae that show me all the calculations I need on a single (horizontal) line for each horse. To handicap, I use this report, and I use Bris's PP Generator to print out the last 3 PPs for each horse.

I play from home, haven't seen the inside of a racetrack in 5 months or so (and probably won't ever go back to the track), and I couldn't be happier with the results.

Having said this, I am an accountant, and this method suits my style. Others might not like it, but, to me, it is like looking at a set of financial statements.

Mike

Derek2U
01-29-2003, 06:06 PM
Guys why dont U pause ... NOT buy any software and do the
hardest step B4 U rush into just another data organizer: How
do U think a software program should behave? Do You really need to analyse more data when the Questions Are Banal at
Best? Just STOP and ThinK .... almost all programmers will tell
you that their biggest problem is that the clients have NO VISION
(or poorly conceived Vision) of WHAT they want to measure.
So, Why bother to begin with?

Dave Schwartz
01-29-2003, 06:57 PM
Derek,

Are you off your meds again? <G>

Your post makes no sense to me.

Dave Schwartz

Derek2U
01-29-2003, 07:35 PM
How much clearer can it be? DO NOT buy software. Stop, ask
yourself what you intend to measure FIRST--- and what will be
your measure of it. That's the hard work. Take for example the
Quirin Point measure thats been talked about here. What a great
idea... just count the up-close positions/lengths & PRESTO ---
0 to 8 pts, but didn't Quirin say that it yielded NO PROFITS ... and
whatever. So please dont measure that old crap again. What
I'm saying is why bother investigating these tiresome issues.
Using Excel & software to look into these factors will only yield
wrong output.

Dave Schwartz
01-29-2003, 07:44 PM
If we use your analigy they shouldn't buy a racing form either.

And so instead horseplayers should do what?

Derek2U
01-29-2003, 07:54 PM
Assuming your reply was 2 me .... They (experienced & newbies)
ought to THINK ... not be lead down that endless path of using
software that stinks. Can they DEFINE what they want to
measure & NOW can they really measure IT? That's the Key.
So, IMO, look to measure EARLY SPEED etc etc Predicively .. not the usual failed measures ... whats the point in doing that?

Dave Schwartz
01-29-2003, 08:04 PM
Derek,

And what is the great secret that you would suggest that other should adopt?

Larry Hamilton
01-29-2003, 08:15 PM
I know, I know, I know--goto the SELECTIONS sections--almost every day there are picks for every track and they cost nothing! What could be better value than that. (tongue planted firmly in cheek)

Donnie@HTR
08-09-2006, 11:27 PM
Somebody musta answered this poll, huh? Last post was from Jan 2003!

PaceAdvantage
08-10-2006, 04:12 AM
Yup, voting in a poll is treated the same way as adding a reply....

BIG49010
08-10-2006, 09:01 AM
New Version of Excel will be out soon, and it will have more columns, this should help some people handle the single file data files.

Pace Advantage, on the cutting edge of handicapping:jump:

sq764
08-10-2006, 08:17 PM
How much clearer can it be? DO NOT buy software. Stop, ask
yourself what you intend to measure FIRST--- and what will be
your measure of it. That's the hard work. Take for example the
Quirin Point measure thats been talked about here. What a great
idea... just count the up-close positions/lengths & PRESTO ---
0 to 8 pts, but didn't Quirin say that it yielded NO PROFITS ... and
whatever. So please dont measure that old crap again. What
I'm saying is why bother investigating these tiresome issues.
Using Excel & software to look into these factors will only yield
wrong output.
Just bet all the grey horses..

Hmm, if i could only develop software that could pull out only great horses..

Wait.. give me a minute

Big Bill
08-11-2006, 03:16 PM
Kitts,

Well, I am considering building handicapping tools for Excel.

Dave

Dave,

I'd be interested in what you may develop for spreadsheet application for handicapping.

Big Bill

ranchwest
08-12-2006, 12:55 AM
Assuming your reply was 2 me .... They (experienced & newbies)
ought to THINK ... not be lead down that endless path of using
software that stinks. Can they DEFINE what they want to
measure & NOW can they really measure IT? That's the Key.
So, IMO, look to measure EARLY SPEED etc etc Predicively .. not the usual failed measures ... whats the point in doing that?

My opinion is that I would want software that had the potential for helping me find predictive measures. I doubt if very many people have been very effective in finding predictive measures prior to analyzing data through software. Even if they have, how long will those same predictive measures continue to be effective?

fastCow
08-12-2006, 06:49 AM
don't use spreadsheets...

Murph
08-12-2006, 08:17 AM
Dave,
I'd be interested in what you may develop for spreadsheet application for handicapping.
Big Bill

I too would be interested in hearing more about your work in this area myself, Dave. Have you done anything that you could share with the public or are the spreadsheets for your software users only? My main interest is in developing some additional products from all of the information our site is processing.

Murph

Dave Schwartz
08-12-2006, 12:53 PM
Nothing I can discuss at this point.


Dave

griz
08-18-2006, 08:45 PM
I have been using Excel everyday for about 15 years. For about the last five I have been downloading the $1. Trackmaster files into Excel. Then you can play with the numbers till your head spins. The software to do it is on the internet for free (ASAP utilities).

Tom
08-19-2006, 04:57 PM
Is this the site?
Looks interesting. Which tool do you use to import the large files?

http://www.asap-utilities.com/

LARRY GEORGE
08-19-2006, 06:33 PM
i used excel in setting up a database for football does some nice equations
for football for horseracing might be to much data to incorparate into
it. :)

griz
08-19-2006, 09:40 PM
Yes that is it. When you download, it comes up on the Excel menu as
ASAP Utilities. When you go into to that go to import/ under import go to import data base file. Then find trackmaster PP

THRRDR.DBF is the the main file you need. download it to the upper left corner cell

the is another file with the names and program numbers

THR2DR.DBF

EQUIPACE
08-23-2006, 01:48 AM
It's been a while since I've posted but, I had to put in a few words or my two cents worth, since I've used Excel im my handicapping for about 20 years now... I've posted a few times about using Excel for handicapping. The benefits are many, and can be extraordinary at times. Do I still believe that? Especially with all the software out there that does all the calculations for you. The answer is YES! Most of the existing software out there, may not tell you how a particular figure was calculated, and based off your own handicapping knowledge it may not agree with your perception of a race. Being a pace handicapper, Excel gives me the flexibilty to experiment and calculate figures based off of my own interpretation of the race. It could be Pace today, or Speed today, or Class today , or Form today, or a combination of all these factors and more.

It's a tool that I can't seem to part with. If you took off every thing but an operating system and Excel on my PC, and gave me some numbers to crunch, I would still be a happy camper. I mean a handi-capper.. ~żo

I mentioned that to Dave Schwartz in a phone conversation many months ago after he saw some samples of my Excel work and he gave me some very positive feedback on them.

There are many players here at PA who are not only Excel geeks, but gurus at building data bases as well, and I'm sure they will agree that using both are a perfect match. (BTW, I'm not a data basing person anymore due to the large amount of space, constant backing up and a few computer crashes that I've had to deal with. It's just not my cup of tea these days.) If you have a data base that can be queried into Excel the possibilities are endless. In other words, your experimentation creating custom figures is the ultimate numbers high. No doubt about it. There are a ton of programs out there that either temporarily or permanently store the information from the BRIS, DRF, Trackmaster file, or whatever you download, into a DB file of some sort. Alot of these files can then be queried into Excel.... Many hours of calculations and importing already done for you. Voila! At the touch of a few buttons. Not to mention, the programs that may not create a DB type of file, but create a text file in a comma delimited (CSV) format that can also be pulled into Excel.

I would really like to know what happened to Larry Hamilton, who posted here for several years. He was an Excel geek turned Data Base freak. I still use many of his formulas in my spreadsheets and he was a Wiz at Excel. I could call him and he always had the right formula or answer for me.

My point to this post is that I am a software junky, and have been for years. But, I still use my spread sheets whenever I handicap, to uncover things that support my own style of play.... Since I query most of my data from several programs these days... It's still very cool because I can then build my own odds line based on whats most important to me, from each program.

Now I'm not going tout any programs here... Or be acused of it either, but
How long does this take? Once I start my programs (About 4 or 5 favorite programs now), and load the card, then export or query to my spreadsheet, about 2 maybe 3 minutes per race and another minute to print on my newest PC. It's a dream come true compared to what I and many others here had to deal with in Excel 20 years ago.

What I'm really looking forward to, is the next version of Excel that will handle more than 256 columns of data.... I can already taste that Excel candy!

John
~żo

BIG49010
08-23-2006, 11:37 AM
Does anybody know when the new Excel hits the market?

zerosky
08-23-2006, 06:01 PM
You can download a fully fuctional beta here

http://www.microsoft.com/office/preview/beta/overview.mspx

The full programme is out in a few months

Tom
08-23-2006, 06:29 PM
Aren't the words "fully functional" and "beta" and oxymoron? :lol:

BIG49010
08-24-2006, 12:17 AM
Spend the $1.50 and try it out, it is really cool ! Takes in complete Drf bris single files, and I would guess you can do just about anything to them. Make a very cool racing form for 1.

I would say Bill Gates and the crew have a real winner here!

Tom
08-27-2006, 11:02 PM
I read this about the new Excel - disturbing the number of fomrat no longer supported - what are you supposed to do with all the spreadsheets you have
already accumulated?
Is this a veiled attempt to "attack" open office?

http://blogs.msdn.com/excel/

Tom
08-27-2006, 11:46 PM
I found this add-on that will import over 1 million columns - has anyone seen this one, or one like it?
Looks like it might be useful without risking a beta program


http://www.add-ins.com/text_file_importer.htm

hcap
08-28-2006, 06:49 AM
Looks like over a million rows, not columns.

Quatro Pro later versions ( I believe 10 and 11 ) will import the single file all columns.
But no VBA.

BIG49010
08-28-2006, 07:30 AM
VB, new Excel, and Access are my X-mas project. I just tried it out, and it appears to be what I have been looking for 20 years. I haven't changed my database from Paradox, but with the movement that is possible here, I guess I may have to do something finally, if I can get someone to start the process.

I think I may have to buy a little Microsoft stock, this appears to me from the surface, a much easier software to work with for the average guy.

Tom
08-28-2006, 10:40 AM
Hcap, yup - you are right - rows.
Thanks.

ratpack
09-15-2006, 10:53 PM
I just use Excel to run the Bet-Smart software

Bizcycle
12-13-2006, 01:25 AM
Corel Quattro Pro X3 takes all the columns and uses VBA.
Only trouble, it is not the (Standard) from MS. Inexpensive
and Imports everything that you can put in your kitchen sink:jump:

Light
12-13-2006, 12:53 PM
Excel 2007 takes a bit of getting use to compared to older versions. Here's a free video tutorial of the basic layout. May need to run the link in I.E.

http://officebeta.iponet.net/client/helppreview.aspx?AssetID=HA100484501033&ns=EXCEL&lcid=1033

spilparc
12-13-2006, 05:32 PM
Whoever posted the link to ASAP utilities thanks a lot. That just made life a lot easier.

spilparc
12-14-2006, 02:23 AM
Yes that is it. When you download, it comes up on the Excel menu as
ASAP Utilities. When you go into to that go to import/ under import go to import data base file. Then find trackmaster PP

THRRDR.DBF is the the main file you need. download it to the upper left corner cell

the is another file with the names and program numbers

THR2DR.DBF

I tried this, but when I got to the trackmaster files it was empty. Also, they are PDF files. Will that work?

raybo
12-16-2006, 09:31 AM
I have been using Excel for handicapping since the early 90's and have no problem getting the data from Bris into it. Infotran, as mentioned by another poster, is what I use and I use macros to go get the new race card data from the target file. Anyone who needs help utilyzing this method can email me and I'll do all I can to get you going.

Tom
12-16-2006, 10:46 AM
I tried this, but when I got to the trackmaster files it was empty. Also, they are PDF files. Will that work?

No - you have to use the EXE PP files. Double click the file and it will expand to several different files - use the ones from this expansion as he describes above.

raybo
12-17-2006, 11:07 PM
Guys,
Excel is 255 cells wide (these are called FIELDS). INFOTRAN will parse the incoming text data which concists of nearly a thousand fields. You cannot have all the fields on one spreadsheet--they dont fit! That is why many of us are not putting the data in Excel, rather we put it in Access and ship to Excel bits to analyze.


Who needs all the fields? If you can't get all the data you need with 255 columns you might be in danger of falling prey to information overload. I use Excel 2000 and have plenty of room for all the data I could possibly need, I only import that data which I need to either fill out my printout in the form I want and that data I use for the manipulations in order to accomplish what I want to regarding handicapping.

Tom
12-18-2006, 06:32 PM
Consider a lot of the fields are 10 races for each horse - PP, 1C, 2C, StrC, Final Call, BL1, BL2, BL3, BL4, account for 90 right there. Works, weights, jocks, all take up to 10.
You have all the info in the PP's one one line.

raybo
12-19-2006, 07:38 PM
Consider a lot of the fields are 10 races for each horse - PP, 1C, 2C, StrC, Final Call, BL1, BL2, BL3, BL4, account for 90 right there. Works, weights, jocks, all take up to 10.
You have all the info in the PP's one one line.

This statement is correct, however,there is no need to get all your data on one line. My data area contains 13 lines per horse, no matter how many horses are in the field. Perhaps some users of Infotran don't really understand what can be done with it. I obtain enough data to have designed my spreadsheet to print out almost identically to that of the Racing Form, which most of us began with and the format for which we are very familiar, except that I obtain much more data than that present in the Form. It all depends on how you construct your Control file. The only sticky point involves dates as you have to be careful what other types of data are in the same columns so that those columns can be formatted for proper date appearance.

njcurveball
01-02-2007, 07:57 PM
I work with Excel gurus all the time. They are happy to devote 200 hours to a spreadsheet that would take about 10 hours using a database.

When they wind up with too much data, THEN they cry help! :bang:

raybo
01-03-2007, 06:55 AM
I work with Excel gurus all the time. They are happy to devote 200 hours to a spreadsheet that would take about 10 hours using a database.

When they wind up with too much data, THEN they cry help! :bang:

What i meant was that I use more of the data from Bris than is available from the printed DRF. Only referring to the format looking like the printed DRF. I don't have a problem with receiving unwanted data, if that's what you meant.

njcurveball
01-03-2007, 01:26 PM
I was more referring to my day to day job than your post. By "too much data", I mean when they start out with a few things, Excel works great. When they have to print a report, still great.

But then they add more and more and more and cannot do reports, cannot query data, and finally cry help.

Think of it like doing your bills in Excel. You start off January and have a column for date and transaction and payee, etc. You print the monthly report and you feel like a genius.

But then February comes and you work a lil harder and read a lil more and you are able to do the monthly for both January and February, a few months down the line, hours are added to do simple things. In a few years, you have 30 sheets and try to merge them to see how much you paid for mortgage, etc.

That is the point where they throw their hands up and come to us. I cannot imagine anyone with the talent of doing the past performance print-out in Excel NOT wanting to use a database.

Jim

raybo
01-03-2007, 06:15 PM
I cannot imagine anyone with the talent of doing the past performance print-out in Excel NOT wanting to use a database.

I don't know if you were referring to me, not using a database, or if it was just a general statement. I spent some time, quite a bit of time, investigating the possibility of creating a database in which to test new methods. But, I decided that the time it would require me to spend to get create it and then learn to use it properly and effectively would be too extensive. Most DB guys I talked with had been doing DB work for years. I've already invested years in my Excel spreadsheet handicapping program. I've already proved that it's good enough to make sizeable profits, if I remain consistent in the remainder of the job, ie: "after Excel" analysis to verify what it has told me is logical, verify that the odds on my ticket, once set, are inline with my minimum expected payout, etc. A database would be nice and timesaving for testing or tweaking, if I already had one and knew how to use it. But, it's fairly easy to do these 2 things a little at a time while I continue to wager and produce income.

K9Pup
01-04-2007, 08:00 AM
I don't know if you were referring to me, not using a database, or if it was just a general statement. I spent some time, quite a bit of time, investigating the possibility of creating a database in which to test new methods. But, I decided that the time it would require me to spend to get create it and then learn to use it properly and effectively would be too extensive.

Excel and Access work well together. Tables in Access can be copied and pasted to Excel, Excel spreadsheets can be linked as tables in Access.

I assume you get some kind of detail data into Excel, probably from a CSV file? If you retain all those detail records in excel without much trouble, then a database probably wouldn't buy you much. But I would have to think that at some point the number of lines WOULD become tough to maintain. With Access you could store those lines in a database, run a simple query to select and build the true input you need for your spreadsheet.

Yeah database guys spend years building their databases. But that is because we go beyond the "simple" stuff. In most cases a person with a fairly good understanding of Excel can create a database in Access in very little time.

Again if maintaining the data isn't a problem now, then you don't really need a database. If you find yourself saying "man I wish I could ......." then maybe you need to consider one.

hcap
01-04-2007, 08:25 AM
I use Excel 2003 to:

1-Open all 1400+ fields in the common data files. Procaps particulary.
Import results simultaneously and "connect" them with each runner.
Import scratchs, race cancelations,track condition, and exotic payoffs as
well

2-Create my own factors as well as those already there.

3-Use the advanced filter built in to query on well over 1 year of data by track, and easily query all my 100 or so factors. Limits are 65,000+ lines, however one track at a time is certainly doable and frequently many tracks can fit in 65,000 lines.

This is a complex "and" filter spot plays. Mid level processor, 1 gig ram approx a few seconds to run, including a variable percentage of bank graphing of my historical plays

4-Take those same runnig lines and create a "dynamic" impact value model, automatically running many months of track specific data and predicting on the fly. For instance, 20 days in model-choose plays for day 21. Advance model one day, choose plays for day 22. Helps avoid extensive backfitting.

All in Excel.

Dave Schwartz
01-04-2007, 09:00 AM
Hcap,

That is almost precisely what we are doing!

Dynamic handicapping is the absolute best way to play IMHO.

How long does this process take for each race? For us it is about 15 seconds and 2 button clicks.


Regards,
Dave Schwartz

K9Pup
01-04-2007, 02:27 PM
I use Excel 2003 to:


3-Use the advanced filter built in to query on well over 1 year of data by track, and easily query all my 100 or so factors. Limits are 65,000+ lines, however one track at a time is certainly doable and frequently many tracks can fit in 65,000 lines.


All in Excel.

What is the source of this query? Are you using the Data, Import External Data, Database Query to query this source?
Thanks!

hcap
01-04-2007, 06:44 PM
K9,

The advanced filter feature is available on the main menu
- Data/ filter / Advanced filter

There is quite a bit of info in excel help. I do use vba to manipulate it some-but not a lot


Dave,

My "importer" will run in batch mode. Data files in one folder corresponding xrd result files in another. On my machine-about 6-10 seconds per card. Daily play without results files a bit quicker. The most memory intensive program of the lot. Getting access to all fields required openning data for each runner one by one. Using the file open method in vba bypasses Excels usual file open command on the main menu. And allows me to work around Excels' 2003 256 column limit

However all 6000 + characters are dumped into one cell. Determining each characters position was very slow using the vba "split" command. I wound up using a stack of text formulas. And then the "text to column" built in to parse those lines simultaneously and split the 1400 fields onto 6 rows.

So fields 1 to 256 on line 1, fields 257 to 512 on line 2, fields 513 to 768 on line 3. Etc. My factors know the cell location of each field and do various calcs and output to a table. No rankings yet. More efficient to do that second in another program.

That program does ranking by race, by factor. Takes about 1 second per card.

If I then copy to the advanced filter program, querying is quite fast. All fields can be used in any combination to discover spot plays. Usually I fill the 65,000 lines available with a few tracks. Tracks that run all year round may be singled in one "filter". With the sheet full, using any combination of factors is a matter of 5-10 seconds. Usually I reverse ranking in the ranking program and use 10 as best and 1 as worst.

The filter is set up with one sheet as sort of a front end. On that sheet I may enter one number as the lowest and one as the highest. So I can vary any factor between any value. For instance less than 11 and greater than 5. In addition there are text and date fields-surface, race classification and so on. My qualifying plays are extracted to a convenient location and I graph my historical bankroll-by either w,p, or show. Percentage of bank is variable.
I find a graph illustrates continuing trends and hits home the long loosing streaks. :rolleyes:

I have found spot plays sufer from a limited shelf life. At least the way I do it.
Some may continue for a while but most die going forward.

The dynamic impact value program is adjustable in terms of number of days to include in the model, type of race, dist., race class, etc. But believe it or not I have been using all races without any restrictions in the model. This was after removing all PACE factors. I have the TSN numbers and calculate the usual Sartin numbers. Could be my pace line selection method needs an overhaul.

Allows me to stay relatively recent and to have a decent 1000-3000 runners in the model. I have tried 60, 30, 20, and 10 days. Surprisingly 10 days is almost as good as 30. And requires a shorter start up period. The program will advance one day at a time. I set the factors in the beginning of my testing as well as the number of days. Takes anywhere from 2 or 3 seconds per day tested for a 10 day model, maybe 6 or 7 for 50 days+ As I said backfitting is quite tricky. I try to stay out of it and let it run. I find keeping things recent is useful

Not all tracks are profitable. Generally 50/50. Some are just dogs. Some are at least break even-maybe -1 to +3% roi. Good ones include CT, Tam, Wo, Haw, GG and CD.

Total time- using the importer then the ranking program and finally the dynamic impact value program, for historical study is maybe 20 or 30 seconds per card. Daily play about the same. I could automate going from one program to another, but have not done it yet. Excel is a memory hog, but workable.

K9Pup
01-05-2007, 08:15 AM
K9,

The advanced filter feature is available on the main menu
- Data/ filter / Advanced filter

There is quite a bit of info in excel help. I do use vba to manipulate it some-but not a lot



Ok. I use the simple data filters all the time. Haven't really used the advanced ones yet. Thanks!!

I also found some VBA code that will parse out a delimited string into elements of an array. It does a good job of splitting a CSV record into multiple elements of an array. If you have any interest let me know.

hcap
01-05-2007, 08:28 AM
The advanced filter is dynamite. I use it all the time.

Vba in Excel is very slow.
To parse 1400+ fields say using the split command takes a while. I have been told in stand alone VB this is not the case.
I use the hard coded worksheet function and formulas whenever I can. User designed functions are probably the slowest. The vartious "built in" features like auto or the advanced filter are the quickest. Using the "text to coulumn" feature is also very quick.

I tried various vba methods to parse. Post a snippet, or email me.
I may have not tried yours.

Thanks.

K9Pup
01-05-2007, 10:33 AM
Here is the code of the function I "borrowed" from somewhere.



Public Function SplitWithQualifiers(ByVal SourceText As String, _
ByVal TextDelimiter As String, ByVal TextQualifier As String, _
Optional ByVal TreatMultipleDelimitersAsOne As Boolean) As String()
Dim strTemp() As String, strRes() As String, i As Long, J As Long, _
A As String, B As String, blnStart As Boolean

If TreatMultipleDelimitersAsOne Then
Do While (InStr(1, SourceText, TextDelimiter & TextDelimiter) And (i < _
100))
SourceText = Replace(SourceText, TextDelimiter & TextDelimiter, _
TextDelimiter)
i = i + 1
Loop
End If
If TextDelimiter <> " " Then SourceText = Trim$(SourceText)
strTemp() = Split(SourceText, TextDelimiter)
For i = 0 To UBound(strTemp)
J = InStr(1, strTemp(i), TextQualifier, vbTextCompare)
If J Then
A = Replace(strTemp(i), TextQualifier, "")
Select Case strTemp(i)
Case TextQualifier & A & TextQualifier ' "xxx"
B = B & A & vbCrLf
blnStart = False
Case TextQualifier & A ' "xxx
B = B & A & TextDelimiter
blnStart = True
Case A ' xxx
B = B & A & TextDelimiter
blnStart = False
Case A & TextQualifier ' xxx"
B = B & A & vbCrLf
blnStart = False
End Select
Else
If blnStart Then
B = B & strTemp(i) & TextDelimiter
Else
B = B & strTemp(i) & vbCrLf
End If
End If
Next i
If B <> "" Then
B = Left$(B, Len(B) - 2)
strRes() = Split(B, vbCrLf)
Else
ReDim strRes(0)
strRes(0) = SourceText
End If
SplitWithQualifiers = strRes()
End Function



Here is an example of a call to the function to parse out a CSV line.


DataElements() = SplitWithQualifiers(PassString, ",", """", False)

raybo
01-06-2007, 12:19 PM
Excel and Access work well together. Tables in Access can be copied and pasted to Excel, Excel spreadsheets can be linked as tables in Access.

I assume you get some kind of detail data into Excel, probably from a CSV file? If you retain all those detail records in excel without much trouble, then a database probably wouldn't buy you much. But I would have to think that at some point the number of lines WOULD become tough to maintain. With Access you could store those lines in a database, run a simple query to select and build the true input you need for your spreadsheet.

Yeah database guys spend years building their databases. But that is because we go beyond the "simple" stuff. In most cases a person with a fairly good understanding of Excel can create a database in Access in very little time.

Again if maintaining the data isn't a problem now, then you don't really need a database. If you find yourself saying "man I wish I could ......." then maybe you need to consider one.

Yes, I use "Infotran" to obtain the data, Bris .MCP files, and put each piece of data into known locations(cells) in Excel, all automated by macros. The only typed or manually done work is in: downloading the data from Bris, typing the answers to the prompts in Infotran's DOS program (5 answers I think).

This results in having all the data I use imported into my handicapping spreadsheet where I then click 2 macro buttons to get the race I want to handicap, run all my sorting macros, etc., and print out a hard copy of my final, personal, "Daily Racing Form type", 2 or 3 page printout, if desired, with "my" numbers and the other race info that I want available for real time wagering. Usually I just view my spreadsheet, real time, so I can manually select running lines and then, before post time, I macro sort the order I want the resulting ratings and corresponding horse numbers to appear and print out a hard copy for later review, note taking, etc.. At present I have over 13mb of calculations, formatting, formulas, etc., not including the raw racing data, in my program. (Takes a few seconds to open)

I do the same routine to get .XRD results files from Bris and put in another sheet in my program, I keep results from approximately 200 racing cards in another sheet, that I set up myself, and with the click of a macro button all 200 or so cards are run against their corresponding results and the information I want to know about is obtained for viewing or printing.

Testing new methods/factors/formulas is a matter of substituting new formulas or new "questions", in regards to the "results sheet", and rerunning the race cards. It takes about 3 or 4 minutes for all the post handicapped cards to run through. So, I go get a cup of coffee or something while it cycles. I know this is rather archaeic, but it works for me.

Not knowing DB or Access, forced me to build my own, years ago, in Excel (probably not as a real Excel guru would have done it, I'm sure), but I learned a bunch about Excel: how to write formulas, what type of data is needed, how to do some basic VB for macros, etc., how to create ways of enabling "quick change" ratings based on other factors and multiples, etc..

In short, while my way takes a little more time than a database program, I still obtain the information I need and keep it updated by replacing old data with recent in order to stay abreast of what the public, what I call "uneducated $2 shooters(lol)", and knowledgeable handicappers are doing.

I don't use handicapping software from anyone else because I believe I have just as much, if not more, knowledge of horse racing as they do and this way I have complete control of the handicapping process. I use Bris' numbers but do my own adjustments to "all" of them, which results in my having figures that no one else in the world has (well, except for my partner, in this, who has more experience than my 30 years worth).

tupper
01-13-2007, 05:50 AM
Hi,

I am new to this forum and new to databases.

Does anyone know how to import DRF (csv) files into OpenOffice Base?

I am essentially trying to create a database from a csv file. I wonder if the field headings can be imported from the Bris/TSN DRF guides?

The OpenOffice spreadsheet will not accept the 1400+ fields of the DRF files, so the import has to be directly into Base, or the DRF has to be converted by some other script/program.

Or, if someone could post a DRF-derived OpenOffice or Access file with the field headings and maybe a few example data rows, I might be able to use the file to start my database.

I am aware of csv parsers/editors that select the desired fields to use, but I would like to retain data from every field, just in case I need the extra info for future, unforseen research.

As I understand it, once a database has all of the fields entered, it is easy to import data from csv files and spreadsheets. Then, a database table can be exported to make the working spreadsheet.

Any input or suggestions to get me started would be greatly appreciated!

Thanks,
-Tupper

K9Pup
01-13-2007, 08:29 AM
Hi,

I am new to this forum and new to databases.

Does anyone know how to import DRF (csv) files into OpenOffice Base?

I am essentially trying to create a database from a csv file. I wonder if the field headings can be imported from the Bris/TSN DRF guides?

The OpenOffice spreadsheet will not accept the 1400+ fields of the DRF files, so the import has to be directly into Base, or the DRF has to be converted by some other script/program.

Or, if someone could post a DRF-derived OpenOffice or Access file with the field headings and maybe a few example data rows, I might be able to use the file to start my database.

I am aware of csv parsers/editors that select the desired fields to use, but I would like to retain data from every field, just in case I need the extra info for future, unforseen research.

As I understand it, once a database has all of the fields entered, it is easy to import data from csv files and spreadsheets. Then, a database table can be exported to make the working spreadsheet.

Any input or suggestions to get me started would be greatly appreciated!

Thanks,
-Tupper

I'm not sure what functions/features are available in the OpenOffice software. If you can execute VB or VBA type code you can write a routine to read the CSV type file and store the fields in multiple tables. Part of the reason there are 1400+ fields is because the data really isn't normalized. Past performance lines are stored multiple times. etc. etc. Multiple tables might include WORKOUTS, LINES, HORSEINFO, TRAINERINFO, etc. etc. Then these tables could be linked together in queries in order to produce the data in a format you want.

If you can't write this type of code, one of the CSV parsers could probably be used to do the same thing, creating multiple tables in your database.

raybo
01-13-2007, 09:51 AM
Hi,

I am new to this forum and new to databases.

Does anyone know how to import DRF (csv) files into OpenOffice Base?

I am essentially trying to create a database from a csv file. I wonder if the field headings can be imported from the Bris/TSN DRF guides?

The OpenOffice spreadsheet will not accept the 1400+ fields of the DRF files, so the import has to be directly into Base, or the DRF has to be converted by some other script/program.

Or, if someone could post a DRF-derived OpenOffice or Access file with the field headings and maybe a few example data rows, I might be able to use the file to start my database.

I am aware of csv parsers/editors that select the desired fields to use, but I would like to retain data from every field, just in case I need the extra info for future, unforseen research.

As I understand it, once a database has all of the fields entered, it is easy to import data from csv files and spreadsheets. Then, a database table can be exported to make the working spreadsheet.

Any input or suggestions to get me started would be greatly appreciated!

Thanks,
-Tupper


Bris and I think TSN have a multi-file that Bris calls: DRF Multi-file Past Performance Data File which includes 4 files of comma-delimited data. I have never used the multi-file format so I don't know if this would help you or not. If you had a parser like "Infotran" that would send each of the files to your database application and put them in separate tables, this might work. I'm not sure if anyone else here has ever used the DRF Multi-file data but you might do a search to find out if posts covering this subject have been made in the past.

tupper
01-16-2007, 01:17 AM
raybo and K9Pup:

Thanks for the helpful advice.

I have been aware of the "Multi" DRF files for a few weeks. The "single" files are more desirable, since I want to retain the currently unused stats for the future, just in case.

I am now leaning towards mySQL or postgreSQL as databases, with phpmyadmin or pgadmin3 or Knoda as a GUI front-end. Such a set-up should be able to output small tables derived from the DRF info, which can be further processed in a spreadsheet.

The hardest part seems to be getting started: entering all the field names, learning how to import the DRFs, etc.

raybo
01-16-2007, 09:10 AM
raybo and K9Pup:

Thanks for the helpful advice.

I have been aware of the "Multi" DRF files for a few weeks. The "single" files are more desirable, since I want to retain the currently unused stats for the future, just in case.

I am now leaning towards mySQL or postgreSQL as databases, with phpmyadmin or pgadmin3 or Knoda as a GUI front-end. Such a set-up should be able to output small tables derived from the DRF info, which can be further processed in a spreadsheet.

The hardest part seems to be getting started: entering all the field names, learning how to import the DRFs, etc.

I agree that getting started is the hardest part. I have toyed with the idea of creating my own database for testing and analysis for years but every time I sit down and open Access to begin, I find I don't know where to begin. That's why I created a DB in Excel years ago and continue to use it today. It's cumbersome, although macros and quick change methods for formulas and multiples help. I would still like to start a DB in Access but haven't a clue how to do it. Guess I'm just DB dumb.

tupper
01-17-2007, 02:21 PM
I agree that getting started is the hardest part. I have toyed with the idea of creating my own database for testing and analysis for years but every time I sit down and open Access to begin, I find I don't know where to begin. That's why I created a DB in Excel years ago and continue to use it today. It's cumbersome, although macros and quick change methods for formulas and multiples help. I would still like to start a DB in Access but haven't a clue how to do it. Guess I'm just DB dumb.


I am definitely DB dumb! I will probably pay a DB expert to get me started.

If I get up and running, I will make available a copy of the initial database file.

njcurveball
01-17-2007, 02:25 PM
With many of the HDW programs, an export is offered. Those programs also have forums with people who are willing to help.

The HTR forum has a section dedicated to Access and people there who know the subject very well.

Seems like it would be a better value to you than paying a large amount for an expert who will get you up and running with stuff you didn't understand and will still have many questions in the future.

Jim

tupper
01-17-2007, 03:58 PM
Jim,

Thank you for the suggestion.

Pardon my ignorance, but what is an HDW program and where can I find the HDW forums? Also, where is the HTR forum?

I have an extra challenge in that I use Linux, and I think the closest thing to Access in Linux is OpenOffice Base. There are many other powerful database programs (with various GUI frontends) available to Linux/Unix, and I might be able to adapt the Access methods to these more robust programs (or pay an expert to set it up).

At any rate, these forums you mention could be a huge help, especially if they relate to handicapping.

If I am successful in getting started, anyone else with PC or PowerPC should be able use my database files, either directly or by booting a Linux live CD/DVD that includes the database program.

Thanks,
-Dale

tupper
01-17-2007, 04:14 PM
I found the HTR forums:
http://www.homebased2.com/forums/

I found the HDW site but not the forum:
http://www.horsedata.com/

I also located the HTR main page:
http://www.homebased2.com/km/htrinfo.htm

I wish this software ran on Linux/Unix.

Thanks,
-Dale

0o0o0
02-14-2007, 07:31 PM
Hey there I use excel and Vba for horse racing.. and it WORKS awsome.. nobody on the planet could do all the math in 20 mins. My programs run exotics and calculates which horses are best paired with others, who the betting community is lookin at and at which times before post.

Also.. a sweet app I made with excel picks me winners... but! Im still not content waiting race after race for it to say OK bet this one.

So I am in the process of making the Vba script in excel... alert when the bet is advised.. login into my betting account select the track the horse number and also read my current bank total, and bet 1/20th of whats in my account.. to PLACE. so.. place betting "punting" more or less.. Very boring if you have to sit through the day.. until a bet looks good.. but im creating an automator.

You guys are behind the times if your not learning excel and Visual Basic. I mean come on.. how much more could you TRY and educate yourself on racing form trends. lol.. ya cant.

Anyhow.. for fun check out this little app out on the market.. Someones got the idea.. which im trying to bring to horse racing.

Ive never tried em.. but.

Poker Bots is the newest craze.. you play 24/7 poker.. or uhmm.. your computer does. And you go on with your normal life.

too good to be true? thats what im thinking.. one of you guys try one and tell me how it goes.

http://www.purely-poker.com/pokerbot.htm

0o0o0
02-14-2007, 08:36 PM
Anyone who has a toteboard method in which they use a pen and paper for.. and it works good.. Lemme know I can put it into an automated hands free task for you.. and you'll be able to cover many more tracks at once.

just send me an email address.


Some of my programs are startling to people at first.. as they click run.. and there mouse and slider bars start running around the webpages and clicking and scrolling all by themselves.. its automation baby! what was thought of as unheard is easy to manipulate now.

raybo
02-14-2007, 10:03 PM
Anyone who has a toteboard method in which they use a pen and paper for.. and it works good.. Lemme know I can put it into an automated hands free task for you.. and you'll be able to cover many more tracks at once.

just send me an email address.


Some of my programs are startling to people at first.. as they click run.. and there mouse and slider bars start running around the webpages and clicking and scrolling all by themselves.. its automation baby! what was thought of as unheard is easy to manipulate now.

Custom macros is nothing new. Lots of people here use VBA and Excel. There are people here who have automated wagering, too. So, I guess you maybe ought to look through some of the other posts.

PaceAdvantage
02-14-2007, 11:53 PM
Some of my programs are startling to people at first.. as they click run.. and there mouse and slider bars start running around the webpages and clicking and scrolling all by themselves.. its automation baby! what was thought of as unheard is easy to manipulate now.

Sorry to say, but more than a few of us have written custom apps in Visual Basic that don't require archaic macros and keystroke recorders....

Using macros and programs like Wintask is way too cumbersome when something silent but deadly can be easily written in Visual Basic or some other higher level programming language....

raybo
02-15-2007, 02:27 AM
Anyone who has a toteboard method in which they use a pen and paper for.. and it works good.. Lemme know I can put it into an automated hands free task for you.. and you'll be able to cover many more tracks at once.

just send me an email address.


Some of my programs are startling to people at first.. as they click run.. and there mouse and slider bars start running around the webpages and clicking and scrolling all by themselves.. its automation baby! what was thought of as unheard is easy to manipulate now.

Makes you wonder where this guy's been for the last few years.:confused:

sjk
02-15-2007, 06:32 AM
Sorry to say, but more than a few of us have written custom apps in Visual Basic that don't require archaic macros and keystroke recorders....

Using macros and programs like Wintask is way too cumbersome when something silent but deadly can be easily written in Visual Basic or some other higher level programming language....

Now I feel bad because I only know the cumbersome way.

Do I have to give the money back?

PaceAdvantage
02-16-2007, 03:53 AM
Now I feel bad because I only know the cumbersome way.

Do I have to give the money back?

No, but you could free up some of your PC resources and make things a lot more efficient....

Anyway, I was just trying to make a point to this guy who is acting as if he's discovered fire for the first time....lol

I was getting the sense that we were being set up for yet another unauthorized sales pitch.....

sjk
02-16-2007, 06:40 AM
I wish I did know how to do this. I know that if I learned how I could run VB from within Excel or Access. My bet generation process (4 keystrokes and a click) uses first a browser, then Excel, then Access.

Would I run the VB from within one of these programs or somehow from outside them?

Also I would really like to know how to automate a simple loop to open an Access database, run a macro and close the database, then repeat numerous times. Would appreciate any suggestions on this.

raybo
02-16-2007, 07:25 AM
I wish I did know how to do this. I know that if I learned how I could run VB from within Excel or Access. My bet generation process (4 keystrokes and a click) uses first a browser, then Excel, then Access.

Would I run the VB from within one of these programs or somehow from outside them?

Also I would really like to know how to automate a simple loop to open an Access database, run a macro and close the database, then repeat numerous times. Would appreciate any suggestions on this.

:lol:

sjk
02-16-2007, 07:43 AM
Raybo,

If my question appeared to be a joke it was not so intended. It would be very helpful for me to know how to do this.

To pose the second problem differently, does anyone know how to get Access to turn loose of the temporary tables without closing or compacting the database.

K9Pup
02-16-2007, 08:29 AM
Also I would really like to know how to automate a simple loop to open an Access database, run a macro and close the database, then repeat numerous times. Would appreciate any suggestions on this.

You can use flags on the startup of Access to run a macro when Access starts.

"C:\Documents and Settings\All Users\Start Menu\Programs\Microsoft Office\Microsoft Office Access 2003.lnk" databasepathname /x MacroToRun

Your Access may be located in a different location.
databasepathname should be the path and DB name of your database.
The /x flag tells Access to run the macro name that follows.


Also if you add a function in that DB like .......


Public Function CloseDB()
Application.CloseCurrentDatabase
End Function


Then you can include as the last step in your macro a RunCode that runs the CloseDB function to close the DB. This will close the DB, NOT close that instance of Access.

sjk
02-16-2007, 10:40 AM
K9Pup,

Thanks for the recommendations. Can you suggest a way to get it to automatically reopen to continue the loop?

K9Pup
02-16-2007, 10:44 AM
K9Pup,

Thanks for the recommendations. Can you suggest a way to get it to automatically reopen to continue the loop?

Why close the DB if you are just going to loop through again and re-open??? Can you leave the DB open and just rerun the macro?

sjk
02-16-2007, 10:50 AM
I want to run it while I am away or overnight. After 15-20 iterations of the macro the size of the database is 2gb due to the temporary tables created and the process hits the wall. If I close the database before that happens the space is reused.

As things are now the process stops and I have to be available to make the db smaller and restart.

K9Pup
02-16-2007, 11:13 AM
I want to run it while I am away or overnight. After 15-20 iterations of the macro the size of the database is 2gb due to the temporary tables created and the process hits the wall. If I close the database before that happens the space is reused.

As things are now the process stops and I have to be available to make the db smaller and restart.

The process stops because of the size????

You can issue that startup command I discussed before each time using the shell command???

You could also create a "temporary" DB each time through. Have the results of your queries stored there. Then close it at the end of the process.

sjk
02-16-2007, 04:46 PM
K9Pup,

I am not sure where to run a shell program. Years ago you could create a batch program to run in the OS (although I never learned the syntax to do so). How would that be done with Windows?

If I someone has the anwser to how to get Access to turn loose of the temp tables that would be the better solution.

This only comes into play when I get the urge to backtest some program change and this only happens 1-2 times a year so I really have no huge issue to deal with.

Thanks for your helpful suggestions.

K9Pup
02-16-2007, 04:55 PM
K9Pup,

I am not sure where to run a shell program. Years ago you could create a batch program to run in the OS (although I never learned the syntax to do so). How would that be done with Windows?

If I someone has the anwser to how to get Access to turn loose of the temp tables that would be the better solution.

This only comes into play when I get the urge to backtest some program change and this only happens 1-2 times a year so I really have no huge issue to deal with.

Thanks for your helpful suggestions.

I'm not sure where you are running your process. In Excel you could have a macro that just does a shell command to start Access with the macro you want.

What do you mean about getting Access to "turn loose" of "temp" tables? Give me some details about the process you run in Access.

sjk
02-16-2007, 05:01 PM
Just running in Access.

The macro handicaps a day's races (iterate for many days) with about 50 lines almost all of which are make table queries. Even if you delete the tables the space they would have taken up counts against the 2 gig limit.

If you compact or close and reopen the space is freed up.

K9Pup
02-16-2007, 05:31 PM
Just running in Access.

The macro handicaps a day's races (iterate for many days) with about 50 lines almost all of which are make table queries. Even if you delete the tables the space they would have taken up counts against the 2 gig limit.

If you compact or close and reopen the space is freed up.

Ok. I do the same thing in my Access process.

IMO the best solution is to create a "temp" DB at the beginning of your loop. All the tables created by your queries can be stored there. The last step of the loop could close the temp DB. Then the top of the loop would rebuild it for the next run through.

You would have to link the tables in the temp database to your "good" DB once. After that Access would look for them in the temp DB. Creating the DB requires a little VB code, but it isn't hard. I can give it to you.

Do you run your queries from a macro or from a module SUB routine?

sjk
02-16-2007, 07:18 PM
K9Pup

Back from dinner and thanks for your interest in helping. I have used macros for everything and have never learned to use modules. I have always been able to do whatever needed to be done but working around the 2 gb size issue has affected my process

If you have VB code to send I would like to give it a try (probably not tonight). Thanks again for the interest in my question.

K9Pup
02-17-2007, 08:26 AM
K9Pup

Back from dinner and thanks for your interest in helping. I have used macros for everything and have never learned to use modules. I have always been able to do whatever needed to be done but working around the 2 gb size issue has affected my process

If you have VB code to send I would like to give it a try (probably not tonight). Thanks again for the interest in my question.

The code isn't complicated. I can put it together and get it to you. You WILL have to link your tables from the temp DB to your good one. How many tables do you have? How many queries do you run in the process? How small does the DB get after the compress?

sjk
02-17-2007, 09:06 AM
I am already using a temp db with links to the larger tables. It is the temp db that gets too large.

Without the large tables it compress down to around 200mb. There are hundreds of tables so linking them all would be impractical.

As to number of queries, for one macro where this issue arises around fifty. For the other less than a dozen.

K9Pup
02-17-2007, 09:35 AM
I am already using a temp db with links to the larger tables. It is the temp db that gets too large.

Without the large tables it compress down to around 200mb. There are hundreds of tables so linking them all would be impractical.

As to number of queries, for one macro where this issue arises around fifty. For the other less than a dozen.

So you create this temp db each time you START your process? Not each time through the loop? The db grows to 2GIG each time you run through once???????

I'm sorry, I think I am losing track of the issue here. Did I get off track?

sjk
02-17-2007, 09:46 AM
It is not that big a deal for me to go on as I have been doing and we are probably trying the patience of everyone that has subscribed to this thread.

I'll respond to your question and then we should probably leave it go.

I create the temp db at the outset with the bigger tables linked. Each time through the loop it grows by 100-200mb. I just let it run but after an hour and 10-20 iterations it crashes into the 2gb limit.

Then I have to intercede to make it small again and restart.

The other application I mentioned is a single macro (no loop) that I have had to break into 4 pieces. The pieces run individually as long as I start them with a compressed temp file but if I put it all together it would get too big.

None of this is a real problem for me. I do appreciate your offer to help but it is probably best for me to continue with what I am comfortable with.

K9Pup
02-17-2007, 09:55 AM
It is not that big a deal for me to go on as I have been doing and we are probably trying the patience of everyone that has subscribed to this thread.

I'll respond to your question and then we should probably leave it go.

I create the temp db at the outset with the bigger tables linked. Each time through the loop it grows by 100-200mb. I just let it run but after an hour and 10-20 iterations it crashes into the 2gb limit.

Then I have to intercede to make it small again and restart.

The other application I mentioned is a single macro (no loop) that I have had to break into 4 pieces. The pieces run individually as long as I start them with a compressed temp file but if I put it all together it would get too big.

None of this is a real problem for me. I do appreciate your offer to help but it is probably best for me to continue with what I am comfortable with.

I will PM you.

RogerSchreiner
03-22-2007, 11:57 PM
Dave,

I use Lotus, but I can also use Excel, it's just that I go back a ways back and Lotus is SO MUCH easier to work with (for me). I would love a spreadsheet- based handicapping product!

However, I'm not sure what you can do besides provide the data. Can you expand just a little on what else you'd do other than provide all your ratings and measures?

I plan on getting much more involved in database handicapping after mid-year as I go into semi-retirement. Aagin, I would love to see you develope a spreadsheet-based program, but I'd love to learm more about what you have in mind...

RogerS

misscashalot
03-23-2007, 01:48 AM
Dave,

I use Lotus, but I can also use Excel, it's just that I go back a ways back and Lotus is SO MUCH easier to work with (for me). I would love a spreadsheet- based handicapping product!

However, I'm not sure what you can do besides provide the data. Can you expand just a little on what else you'd do other than provide all your ratings and measures?

I plan on getting much more involved in database handicapping after mid-year as I go into semi-retirement. Aagin, I would love to see you develope a spreadsheet-based program, but I'd love to learm more about what you have in mind...

RogerS

about 20 yrs ago I started a spreadsheet/database using MS Works. After a few years I reached its limit and switched to Excel, which I have been using since 1994. I have a db now reaching about 18mb. Im up to about 40,000 lines and currently have about 60 columns. The number of cols changes time to time when I add or subtract data which I was studying. I subtract data that I eventually judge to be of no help or when I reach a conclusion. If you want a sample PM me with your email address and I send you a portion.

raybo
04-07-2007, 01:15 PM
Guys,
Excel is 255 cells wide (these are called FIELDS). INFOTRAN will parse the incoming text data which concists of nearly a thousand fields. You cannot have all the fields on one spreadsheet--they dont fit! That is why many of us are not putting the data in Excel, rather we put it in Access and ship to Excel bits to analyze.

So, if you want every field in the CSV file in one spreadsheet just create 2 control files and 2 target files. Then create a macro that copies and pastes the 2 target files to 2 specific places in your spreadsheet. Now all the fields are in the spreadsheet and you know where each field is located. The rest is easy.

raybo
04-07-2007, 01:39 PM
Also, just because you only have 255 columns in Excel doesn't mean that all your data has to be put on the same row. I use 13 rows for each horse (in a 10 horse field that would be 1300 rows) and only 50 columns wide (that's a possible 65,000 pieces of data for a 10 horse race). With this cell area I can get, IMO, all the necessary data one would ever need to properly handicap. Then with a little macro help I get each race copied to another area so that all my cell references for my formulas, etc. are consistent every time. I automate the "RaceGet" so all I have to do is click on which race I want and that race gets pasted, handicapped, sorted, etc, and printed out, if I want. I also have a manual override built in so I can change the computed handicapping portion (line selection, form change, spot play, etc.).

But, if you want every single field in the spreadsheet you would have to use more cell space (pasting 2 (or more?) sets of data in separate cell areas, which means you have to run Infotran more than once per card). The only problem I have is when the data is dates, this can be tricky when placing other data types in the same column, it would be wise to only put dates in the same column so you don't have to do any other work to get the data represented like you want.

dutchboy
04-17-2007, 07:12 PM
Excel 2007 may be what you need.

16,385 columns available
1,048,578 rows available

Beethoven
05-12-2007, 06:46 PM
Excel 2007 may be what you need.

16,385 columns available
1,048,578 rows available

And... It has a new user-friendly interface called "The Ribbon" (see attachment). I think even a dumb blonde like me can learn to work with that! ;)

Microsoft has a good tutorial for it too.

http://office.microsoft.com/training/training.aspx?AssetID=RC100766511033


I'm looking to buy one soon, to still use with XP.

Topcat
05-13-2007, 06:44 PM
Excel 2007 may be what you need.

16,385 columns available
1,048,578 rows available

This will be my next piece of software. With the new features, a million + rows and 16 k in columsn it will allow users to do in excel much of what had to be done in a relational database.

Has anyone used it and are there any memory or speed issues in
large files?

Thanks
TC

PaceAdvantage
05-14-2007, 03:08 AM
I think even a dumb blonde like me can learn to work with that! ;)

Well, let's see....

a) you're not dumb
b) you're probably not blonde
c) you're probably not even female

How did I score, Hon?

Kelso
05-14-2007, 03:15 AM
With the new features, a million + rows and 16 k in columsn it will allow users to do in excel much of what had to be done in a relational database.


Would this involve pivot tables? (Only vaguely familiar with their function.)
Thank you.

K9Pup
05-14-2007, 08:40 AM
This will be my next piece of software. With the new features, a million + rows and 16 k in columsn it will allow users to do in excel much of what had to be done in a relational database.

Has anyone used it and are there any memory or speed issues in
large files?

Thanks
TC

I haven't installed it yet, but you have to think there will be memory and speed issues. I would GUESS that excel will load parts of the spreadsheet into memory. As you page through rows additional data will have to be moved from disk to memory. So like all MS products. more memory, fastest processors = best performance.

Here is one reference from the MS site about the performance of excel 2007. You can also do a search for "excel 2007 performance issues" and see several others.

http://msdn2.microsoft.com/en-us/library/aa730921.aspx#Office2007excelPerf_BigGridIncreasedLimitsExcel

Beethoven
05-14-2007, 09:23 AM
Well, let's see....

a) you're not dumb
b) you're probably not blonde
c) you're probably not even female

How did I score, Hon?

1 win, but no trifecta. Does 'probably' count as a pick?


My turn, okay?

a) you're not dumb
b) nobody's gonna fool you!
c) women are welcome but if they flirt a bit, they're liars and not entertainers

How'd I score?

I have to prove who I am? Why, because I'm a woman? Any of you have to prove who you are? Puhlease!

Kelso
05-15-2007, 05:25 AM
I have to prove who I am? Why, because I'm a woman? Any of you have to prove who you are? Puhlease!


Well, it would be very nice of you to prove at least that you're the chick in the pic.

PUHLEASE!!! :jump:

Beethoven
05-15-2007, 05:53 AM
Well, it would be very nice of you to prove at least that you're the chick in the pic.

PUHLEASE!!! :jump:

Dream on, Suger... and have fun doing it! Heehee :)

raybo
05-15-2007, 07:06 AM
Well, it would be very nice of you to prove at least that you're the chick in the pic.

PUHLEASE!!! :jump:

Who cares what gender she/he is? I thought this was a horse racing forum, not a meat market.

Beethoven
05-15-2007, 07:39 AM
Who cares what gender she/he is? I thought this was a horse racing forum, not a meat market.
Oh yeah? Then what are all the knives out for?

Actually it's a meet market...for horseflesh anyways. :)

Topcat
05-17-2007, 03:23 AM
Kelso,

Pivot tables would be one way but you can actually get a lot of info just using filters-

Kelso
05-18-2007, 03:16 AM
[QUOTE=Topcat]
Pivot tables would be one way but you can actually get a lot of info just using filters-
[QUOTE]

Thank you, Topcat. Are "filters" a feature that appeared subsequent to Excel 2000? I've used the product extensively, but don't recall seeing mention of them. (Still playing in the Dark Ages here.) Thanks again.

Hammerhead
05-18-2007, 07:45 AM
Look under Data on top of excel screen. There is auto filter and advance filter. Advance filter is by far a great way to get specific data.

Kelso
05-19-2007, 01:30 AM
Look under Data on top of excel screen. There is auto filter and advance filter. Advance filter is by far a great way to get specific data.


SONOFAGUN!! Been using Excel for almost 25 years (including MultiPlan) ... never knew that was there! :blush:

Thanks very much, Hammerhead. Gonna have to see what the help files and tutorial can teach me about this. :jump:
And thanks, again, to TopCat for alerting me to filters.

K9Pup
05-19-2007, 08:59 AM
SONOFAGUN!! Been using Excel for almost 25 years (including MultiPlan) ... never knew that was there! :blush:



Here is something else you may or may not know about. On the very bottom bar of the excel window (not sure what it is called) if you RIGHT click you can select a simple calculation on the currently selected cells. You can select avg, count, max, min and sum.

You can combine this with the filters. Say you select avg and then select an entire column. The avg of that column appears. But then you can filter the sheet and see the avg of the filtered cells only.

hcap
05-19-2007, 09:23 AM
Originally Posted by Hammerhead
Look under Data on top of excel screen. There is auto filter and advance filter. Advance filter is by far a great way to get specific data.The advanced filter is very powerful. I have queried on excels' limit of approx 65,000 lines. Up to 150+fields simultaneously, and on a relatively new machine-will get results in under a few seconds.

For instance, asking
1-How well does a runner do if ranked within any factor, say better than 5th?
2-If the Trainer and Jock were better than rank 4?
3-If also back in greater than 8 days and less than 90?
4-Etc.
............

I could add up to 256 items to this list, but you can fill in your own.
Point is a rather large "and" spot play can be assembled easily using all field criteria simultaneously. The "auto filter" is much more limited in how many criteria may be used together, and although easier to initially use, gets to be very cumbersome quickly as compared to the advanced filter.

Kelso
05-20-2007, 01:51 AM
Here is something else you may or may not know about. On the very bottom bar of the excel window (not sure what it is called) if you RIGHT click you can select a simple calculation on the currently selected cells. You can select avg, count, max, min and sum.

You can combine this with the filters. Say you select avg and then select an entire column. The avg of that column appears. But then you can filter the sheet and see the avg of the filtered cells only.

Cool! Absolutely correct ... new to me. Thank you, Pup. Will be able to use this one right away.

Thank you to hcap, also. Makes clear how deep I should go with this. Think I'll invest in a "how to" book ... maybe get started with a "for Dummies."