Plenty of numerical algebra libraries have been developed in recent years. These libraries are tuned for the given CPU and its memory architecture, fully utilize its memory hierarchy and inner pipelines. There is a new trend in the high-performance computing: GPU computing. This trend is caused by the surprising fact that the most powerful part of modern Intel PCs is not the CPU, but the GPU. Modern graphic cards (shortly GCs) overcome modern CPUs in the memory bandwidth and possibilities of the vector execution. It results in their suprising floating point performance..