To find the fastest way to read a file line by line you will have to do some benchmarking. I have done some small tests on my computer but you cannot expect that my results apply to your environment. Using StreamReader.ReadLine This is basically your method. For some reason you set the buffer size to … Read more
A better way is to use the Stopwatch class: using System.Diagnostics; // … Stopwatch sw = new Stopwatch(); sw.Start(); // … sw.Stop(); Console.WriteLine(“Elapsed={0}”,sw.Elapsed);
Some people would say that two threads is too many – I’m not quite in that camp 🙂 Here’s my advice: measure, don’t guess. One suggestion is to make it configurable and initially set it to 100, then release your software to the wild and monitor what happens. If your thread usage peaks at 3, … Read more
Since it doesn’t seem like anyone has done this before I thought it’d be good idea to have it for reference somewhere. I’ve gone though and either via benchmark or code-skimming to characterize the array_* functions. I’ve tried to put the more interesting Big-O near the top. This list is not complete. Note: All the … Read more
Profilers are definitely a good way to get numbers, but in my experience, perceived performance is all that matters to the user/client. For example, we had a project with an Ext accordion that expanded to show some data and then a few nested Ext grids. Everything was actually rendering pretty fast, no single operation took … Read more
Denormalising to improve performance? It sounds convincing, but it doesn’t hold water. Chris Date, who in company with Dr Ted Codd was the original proponent of the relational data model, ran out of patience with misinformed arguments against normalisation and systematically demolished them using scientific method: he got large databases and tested these assertions. I … Read more
There’s a very simple answer to this: Profile the performance of your web server to see what the performance penalty is for your particular situation. There are several tools out there to compare the performance of an HTTP vs HTTPS server (JMeter and Visual Studio come to mind) and they are quite easy to use. … Read more
I suggest that you use a profiler to test which is faster. My personal opinion is that you should use Lists. I work on a large codebase and a previous group of developers used arrays everywhere. It made the code very inflexible. After changing large chunks of it to Lists we noticed no difference in … Read more
The newest versions of pandas now include a built-in function for iterating over rows. for index, row in df.iterrows(): # do some logic here Or, if you want it faster use itertuples() But, unutbu’s suggestion to use numpy functions to avoid iterating over rows will produce the fastest code.
The first way is easier to maintain. Each declaration is a single statement on a single line, so you can easily add, remove, and reorder the declarations. With the second way, it is annoying to remove the first or last declaration because they start from the var keyword and finish with the semicolon respectively. Every … Read more