Tick Database Version 2 - Page 2
Page 2 of 844 FirstFirst 1234 LastLast
Results 11 to 20 of 31

Thread: Tick Database Version 2

  1. #11
    Ok, here's the situation...

    In the past 3 days, because of your contributions, the database collected nearly 3 million ticks. That averages to about 11 ticks per minute, or 660 ticks a minute. The server the principal database was hosted could not handle the load and the website was disabled.

    My backup database is still collecting ticks, therefore there's not any reduction in data continuity.

    I am not certain how I'm going to distribute the data, but I am certain that it will be a long time before I am able to provide any type of tick feed. Rather, I am in the process of copying information to .csv documents, and uploading them en-masse to several data-hosting sites like Rapidshare, megaupload, etc..

    I am currently working on constructing a local mysql server to handle the unbelievable number of information that you contributed.

    If anyone else understands LAMP or will help build something similar, I would really like to talk with you personally.


    I must also note that all the [TD] empowered EAs will still work. The exclusion is HiLo Trader [TD]. This was the only EA which relied upon a flow of ticks downloaded in the database. The EA will still work, but it will only be utilizing bar data.

  2. #12
    3 million ticks! That must take up a lot of room!

    Imagine if you split it up each day? Like make a cronjob that runs every 24 hours to save the last 24 hours worth of ticks to your csv file and deletes the information from the database? Then whoever wants to download can download all of the csv files and egorize them however they prefer.

  3. #13
    Working on it.

    The problem with conducting a daily cron job is the risk of bypassing some info. I had set a weekly cron job to place the ticks in a csv file. It was supposed to run saturday at midnight (my time) but obviously will not run until I can find a better more sensible host.

    3 million ticks is about 100MB if you are attempting to scale it. The major problem I ran across was too many simultaneous incoming stre to one database. Do you understand anything regarding delaying or redistributing the load elsewhere? (E.g. a different database on a different server?)

  4. #14
    Just came back.
    A fantastic quality Shared host, I know of starts with 2.5/month. . .may be 2 accounts ? Or Everything about the Gogrid trial thingy..thats approx 100days with smallest ram server (incoming bandwidth is free on it)

    As regarding rescuing CSV files and bandwidth issues with them... many great (YES GOOD,even non-refundable ) free hosts are around. So we dont want bandwidth actually for it.

    The dialogue Appears to be over according to the connection. Any conclusions?

  5. #15
    Currently, I'm trying to obtain a MySQL server set up in my dorm. I'm working with UITS (campus IT division ) to accept that project.

    I considered multiple accounts. But there is a problem. . .how do I program the load-balancing?

    Go-Grid is my very last resort, although... if I have a ready market to buy encode information, I would think about going this route: http://www.gogrid.com/bizspark/

    As I'm seeing it: People who contribute to the tick database can regain x multiple of those ticks they donated. I doubt any of you would like that. I would also look at charging people who don't contribute at all...

    Orr... set up the tick database for a membership website, where the membership fee is a straight cut of all my prices that month are. I'm looking at ~$150/month for a totally dedied server. I really only need a dedied MySQL server, the web interface can be run on a shared host.

    If anyone can find a nice economical mysql hosting platform, I'd surely be interested.

    I'm expecting usage at 2,000 INSERT asks (ticks) a moment based on my estimates on the number of men and women are actively using my EAs.

  6. #16
    I could possibly host this, how much bandwidth are we speaking? How much cpu useage etc do you estimate?

  7. #17
    I just opened a brand new account with WebHostingPad.com

    Hit it with what you have!

  8. #18
    Its a quad core, lets see where this goes, perhaps I can pop a VM for you.

  9. #19
    Hi RR.. Won't the fundamental Cloud server with those trial $$$ can help?
    The fundamental Ram of 0.5gb and all incoming visitors free amounts to about free 40-50days. Those that are really involved curious can sign up individually totaling to about atleast some 5-6months. .that's enough I think, at least as of now

    Anyway. . .the new server u got is which one? Basic shared hosting?
    Dont think it could take it....though its vaion season. . .lets c

    Any ways, I am shooting with 12 pairs on two Live brokers..Alpari Uk and FxPro

    I believe that you should accept/add 2 from Gold/Oil/Silver.
    They're commonly traded and very often on many brokers.
    Allow me to know..if you can.

    Regards

  10. #20
    Quote Originally Posted by ;
    Great project.

    Sorry for what is probably a very stupid question but how can I import the encode data to Metatrader for use for testing an EA?
    Step by step here

    http://eareview.net/tick-data

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
This website uses cookies
We use cookies to store session information to facilitate remembering your login information, to allow you to save website preferences, to personalise content and ads, to provide social media features and to analyse our traffic. We also share information about your use of our site with our social media, advertising and analytics partners.