Is there any need for an open source data processing tool?

[DeltaLover]

Would you like to have an open source framework to process bris files, to do handicapping factor research, print custom reports and racing programs, create custom figures etc?

Note that I am not referring to a front end GUI application but to programming APIs instead.

[DJofSD]

As a web based tool or something else?

When I see "API" I think programming using a language translator on my system. Data could be local, on a server or "cloud based."

[Capper Al]

Isn't JCapper something like this?

[DeltaLover]

Originally Posted by DJofSD

As a web based tool or something else?

When I see "API" I think programming using a language translator on my system. Data could be local, on a server or "cloud based."

Not necssary web based. The library will be able to collect the data from the file system or data bases running as a pyhon object. Of course this functionality can always be exposed through a web server hiding all the data retrieval and processing details.

[DeltaLover]

Originally Posted by Capper Al

Isn't JCapper something like this?

I am not exactly sure about JCapper. Is it open source anyway? I thought it is a propertitary system but I might be wrong..

[DJofSD]

Not sure if Jcapper would be what is originally being asked about.

Jeff is a member of this community and better describe what JCapper is all about. But, to help narrow the focus of the thread, this is how I would describe JCapper: a Windows platform app which uses handicapping data from different web based data providers and gives the end user a means of handicapping races using either predefined criteria, or, user created criteria. A back-end data base is stored locally, and, updates to and maintenance of the database are incorporated into JCapper and perform in an unobtrusive manner, keeping the local data base current but without the end user needing knowledge of relational databases.

Now, again, I am offering what I know about JCapper from many years ago when I had obtained it then and learned what I needed about it as part of an exploration of my own. JCapper is written in Visual Basic and would likely not lend itself too readily to any extension via an open source API that is being discussed in the thread. But then I could be very wrong and Jeff can correct my errors.

[SpotPlays]

DeltaLover, I don't believe this is not something BRIS would approve of, per their customer terms and agreements.

[DJofSD]

Originally Posted by SpotPlays

DeltaLover, I don't believe this is not something BRIS would approve of, per their customer terms and agreements.

Do you mean this notice:

Products created with data that were supplied by and are proprietary to Equibase Company LLC. All rights reserved. Reuse of this data is expressly prohibited.

Data provided or compiled by Equibase Company LLC generally are accurate but errors and omissions occur as a result of incorrect data received from others, mistakes in processing and other causes. Churchill Downs Technology Initiatives Company and Equibase Company LLC disclaim responsibility for the consequences, if any, of such errors, but would appreciate having any such errors called to their attention.

The copyright and disclaimer applies to any inquiry run during this session, or to any information retrieved from our World Wide Web Site now or in the future. No part of this inquiry may be reproduced in any form or by any means without written permission of Copyright © 2014 Bloodstock Research Information Services. All rights reserved.

[raybo]

Storing and distributing proprietary data from another provider would be illegal, unless the distributor has express license to do so from the data provider. Providing a program that uses purchased data from another provider, for the program's users' own use, without further distribution, would not be illegal.

So, creating any open source, or closed source, software that imports and manipulates proprietary data, from localized files (stored on their own computer or their own personal "cloud" storage account), would be legal, as long as the proprietary data itself is not included with the software offering to others. However, if the software's creator has entered into legal contractual agreement with the data provider for access, download/purchase, and import of that data into the software, then that could also be legal as long as the user(s) of the software does not circumvent any portions of the original contractual agreement.

So, as long as the individual users of the software, purchase their own data, legally, the creator of the software itself would not be held responsible for any illegal activities by the individual users of the software.

That is my understanding anyway.

[DeltaLover]

Of course, I am only refering to the library itself, assuming the data will be stored in a local repository. There is not intention of publishing racing data at all, each user will have its own copy of data stored localy and configure the API to connect to them

[Tom]

OK, like the old punch card days.
We had a big computer on campus, and we all learned how to key punch cards that we took there and they ran them for us in a program of our choice, we came back a few days later and picked up 345 pounds of print outs. I used my slide rule to separate the sheets!

But I get your drift.
I think yes, it would be very useful. I have no clue no desire to do this on my own, but if a third party existed to allow me to run my data, I would be very interested.

It is sad the INDUSTRY does not looks for ways to improve itself by cultivating and encouraging its customers. Unless of course you like pink hats.

Good idea.

[raybo]

Originally Posted by DeltaLover

Of course, I am only refering to the library itself, assuming the data will be stored in a local repository. There is not intention of publishing racing data at all, each user will have its own copy of data stored localy and configure the API to connect to them

I think that there would be great interest in such a program, as long as one doesn't need to be a programmer in order to "make it their own", by being able to easily manipulate the raw data to create their own factors.

That was my original intent with the "AllData Project", provide a simple means of importing local Bris files into a widely held app, like Excel, provide the basic PPs, and allow the user to create their own factors and views, without having to learn a programming language. We accomplished all of that, and more.

[Robert Goren]

Most of us would not mind paying a reasonable fee for historical data. Unfortunately what most of us consider reasonable and what the providers charge are oceans apart. That is the problem that all software of this type face. Trying to operate on a few months of data because of cost concerns and adding to it as you bet seldom works although I think that is what most users try. Who wants to invest a couple of grand into buying data with no guarantee that you find anything useful?

[Robert Goren]

Originally Posted by Tom

OK, like the old punch card days.
We had a big computer on campus, and we all learned how to key punch cards that we took there and they ran them for us in a program of our choice, we came back a few days later and picked up 345 pounds of print outs. I used my slide rule to separate the sheets!

But I get your drift.
I think yes, it would be very useful. I have no clue no desire to do this on my own, but if a third party existed to allow me to run my data, I would be very interested.

It is sad the INDUSTRY does not looks for ways to improve itself by cultivating and encouraging its customers. Unless of course you like pink hats.

Good idea.

Been there, done that. Even doing a sample of 50 races was a huge undertaking.

[Tom]

Remember the dreaded data clerk who came back to the window without the reams of paper printouts?

"You must have an error in one of your (3 million) punch card! Go fix it and bring them back in!"