As has been pointed out already, you’re not looking for the derivative. You’re really looking for a “significant change” detection algorithm for a time series. You’ll certainly want a smoothing filter (and the moving average filter is fine — see Bjorn’s answer for this part). But in addition to the smoothing filter, you will also … Read more
To be precise, garbage collectors are a problem for real-time systems. To be even more precise, it is possible to write real-time software in languages that have automatic memory management. More details can be found in the Real Time Specification for Java on one of the approaches for achieving real-time behavior using Java. The idea … Read more
So the concern for “real time” is the latency introduced by GC collections. GHC uses a multicore garbage collector (and there is a branch with per-thread local heaps). Originally developed to improve multcore performance (each core can collect independently) by reducing the cost of frequent stop-the-world synchronisation, this happens to also benefit soft-real time for … Read more
What are the essentials of distributed real-time systems? A distributed real-time system composes two challenging sets of properties which are imposed by the problem domain or the solution domain (or both.) Distributed A distributed system links a number of independent computing entities with local properties by way of a communication mechanism. As a consequence, algorithms … Read more
Just some thoughts: Environmental Datasets As stated by the other comment, have a look to weather, forecast (or similar services). Space data What about data from the Universe? Flights Here’s some real time flight tracking data: the evaluation plan is limited but free. Social Networks Twitter Streaming API, Facebook RealTime Updates API (in case you … Read more
I’ve been a developer on public telephone switching system software, which has pretty severe constraints on reliability, availability, survivability, and performance that approach what spacecraft systems need. I haven’t worked on spacecraft (although I did work with many former shuttle programmers while at IBM), and I’m not familiar with VXworks, the operating system used on … Read more
Firstly, 1 ms is an eternity in HFT. If you think it is not then it would be good to do a bit more reading about the domain. (It is like being 100 miles away from the exchange.) Throughput and latency are deeply intertwined as the formulae in any elementary queuing theory textbook will tell … Read more
What about D Programming Language? Some links requested in the comment: Win32 Api Derelict (Multimedia lib)