Tick Database Version 2
Page 1 of 844 123 ... LastLast
Results 1 to 10 of 31

Thread: Tick Database Version 2

  1. #1
    After going through a few months with the first Tick Database, there were a few glaring flaws I Discovered: Retrieving the data was challenging for any end user. Query crashes were regular. Downstream users were sometimes crashing the server. With that in mind--and the fact that my hosting agreement was almost up--I took the chance to recreate the database and hopefully make it more usable for everybody to have usable tick info.

    The database is currently setup for 20 pairs: AUDCAD AUDJPY AUDNZD AUDUSD CADJPY CHFJPY EURAUD EURCAD EURCHF EURGBP EURJPY EURUSD GBPCHF GBPJPY GBPUSD NZDJPY NZDUSD USDCAD USDCHF USDJPY Whether there are any other pairs you want to increase the database, let me know. I only ask that if you want those pairs, which you please donate to them.

    Each Saturday, the prior week's data will be exported to a csv file and saved in a folder on the site. I am currently in the process of migrating the old database to the new one, so preceding tick data will be available soon.

    Tick Loader 4. Mq4 is the principal method of contributing ticks to the database. All you need to do is use it to a chart, and make certain DLLs and EAs are enabled.

    The other method to donate ticks is through a number of my especially marked EAs. Any EA released by me together with the [TD] designation has the capacity to contribute to the tick database. Those EAs will have a parameter marked TickDatabase, set it to true to allow the EA to ship ticks.

    There are only 5 pieces of information I am collecting: Broker TimeKnowing the broker's time will be useful in trying to line up tick feeds collectively. BidWant the bid price AskWant the ask price Broker NameIt will be useful to understand where a tick came from, particularly if--following analysis--it will become known that a broker's tick feed is poor. UserNameIn the event the costs to run the database becomes prohibitively high for me to support itself, I may turn the website to a membership site which allows downloads based on amount paid, or ticks contributed. By associating a tick with a user, I will keep track of who led the number of ticks. Nothing will be personally identifiable. I am not amassing account numbers, account margin, etc..

    For any programmers who wish to use the sign up database, or a slightly-delayed tick stream, please contact me via PM, or my Support Ticket Center and that I will get you setup.
    https://www.forexforum.co.za/attachm...1362796193.mq4

  2. #2
    Bandwidth should be minimal, around maybe 10GB/month uploading ticks and exporting them to a free host.

    CPU use might be a issue.

    When JustHost suspended my account, they told me I had been using 30% of their CPU. The database was around 800 insert queries per minute when that happened. If you'd like to run some benchmarks let me know and I will send you the source code.

  3. #3
    Source code is up there. I didn't write the dll, microsoft did. It's the same DLL that Fxcal uses. It's basically a mini-web browser.

    1 EA for every pair that you want to contribute.

    Cheers Ben!

  4. #4
    Is the EA still sending each and every tick separately?

  5. #5

  6. #6
    I updated to version 4, will you verify if it is working. I no longer see IBFX information updating on the internet site for GBP/CHF.

    I switched back to version 3 and that I see the updates, I will switch back to 4 and let me know if you see anything on your end.

  7. #7
    Yep, it's working. Check your PM for more details.

  8. #8
    Nice to see that the 2nd thread..yes those things get better with time.

    Do you have any way to filter demo ticks?
    I dont believe demo tick accumulation between the ones that are live. . Will be helpful for the databse. We all know brokers dont care about demo stuff..and spreads are quite different.
    Or even tickloader doesnt work on demonion?

    Regards

  9. #9
    It functions on demonion, that's not really a problem, and yes, there is a delimiter between live and demo interviewers, so they can be filtered out.

    I've a slightly larger issue.

    The response was much larger than I had anticipated, and my webhost shut the website down. I still have backup ticks feeding at another host, so no data has been technically lost.

    Here are my choices:

    1) Limit contributors.
    Two ) Dedied hosting.

    Limiting contributors is not really something I wish to do, but it appears that I might only have to take action.

    I might also go the hosting course, but that'll cost a minimum 149/month (as opposed to the $3/month I currently cover ). Will anyone be willing to contribute fiscally?

    Twee, I understandforexforum.co.zahas considerable funds, do you and the rest of theforexforum.co.zadev staff consider a partnership? The entire infrastructure and back of the tick collection system is set up, I simply need to get a house capable of running it.

  10. #10
    I'm holding a video/audio conference to discuss this issue and what options you'd rather see me to take.

    You are able to join me http://www.tokbox.com/conf/x62kodgz9pbu8ctg

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
This website uses cookies
We use cookies to store session information to facilitate remembering your login information, to allow you to save website preferences, to personalise content and ads, to provide social media features and to analyse our traffic. We also share information about your use of our site with our social media, advertising and analytics partners.