category:esProc

All about esProc.

esProc Heterogeneous Datasources – JSON and HTTP

JSON is a common data-interchange format. JSON data come from external Java programs, local files or the HTTP server. esProc can easily parse the JSON strings and compute them.  The following examples will show in detail how to write an esProc script for doing this.  The first case is the one in which the JSO...

2015-03-18 1167 0 0

esProc Heterogeneous Datasource – Hadoop

esProc’s Hadoop datasource includes mainly HDFS files and Hive database. The way of accessing Hive database is similar to that of accessing other databases, so we won’t discuss it here. esProc has the built-in method of accessing HDFS files, which resembles that of accessing files from an ordinary file system. We’ll in...

2015-03-18 1071 0 0

esProc Heterogeneous Datasources – Excel

esProc can import the data from and write them into Excel files by making the Excel one of its various datasources. Two simple examples will show how this works. First let’s look at the data importing. The target files are data.xlsx and data.xls (excel97-2000 format) and have the same content. sheet0 is named employee ...

2015-03-06 1085 0 0

esProc Program: Loops

With esProc, the code for a loop is mainly written with for statement. The for statement will repeatedly execute the code block with for being the master cell. There are different formats of for statements, as listed below: 1. for loop An unconditional loop is the one where the values of the master cell are, in tu...

2015-03-05 947 0 0

esProc Program: Branches

When using branch statements, we need to check one or multiple conditions, execute different code according to the results or return different results. In esProc, the if/else statement is used to realize branching. It has the following forms: 1. if x … else … in the same line When condition x after if is true, the stat...

2015-02-28 863 0 0

esProc Integration & Application: User-defined Functions

Besides the system-provided functions, esProc supports invoking user-defined functions to handle some special operations or the encapsulation of certain computations. This article will briefly explain how to invoke user-defined functions with invoke function and how to use parameters and return the results as needed. 1...

2015-02-27 986 0 0

esProc Getting Started: Option Syntax

1. esProc’s function options Many functions in esProc can use function options with which the same function can have different work patterns. The basic format of function options is f@o(…) in which o is f function’s option. For example:   A B 1 2004-5-5 2014-7-7 2 =interval(A1,B1)   3 =interval@y(A1...

2015-02-18 975 0 0

esProc Parallel Computing: The Server

Parallel computing solves a computational problem by breaking it apart into discrete subtasks and distributing them among multiple servers on which they will be implemented concurrently. Each subtask returns its own computational result to the master task for combination. Through the simultaneous use of multiple comput...

2015-02-17 1641 0 0

esProc Parallel Computing: Multithreading

Sequential computation was the simplest and most intuitive processing method for handling computational tasks. Contemporary servers and PCs, however, have gained the multi-tasking ability with multi-core CPUs. Under the circumstances, sequential computation cannot make the most use of the computational power the CPU of...

2015-02-16 1255 0 0

esProc Getting Started: Use of Common Data

To make data analysis, first you need to load the original data. The data used most frequently comes from the text files or the databases. In esProc, you can load data from the text files or the databases easily and quickly. 1. Text file data esProc can loaddata from a text file as a table sequence. For example, the te...

2015-02-11 1047 0 0

esProc Getting Started: Multilayer Parameters

esProc provides a large number of functions, many of which use many parameters. In order to clearly judge the positions of these parameters and make writing and reading easier, esProc is specially equipped with multilayer separators of function parameters. 1. Separators of function parameters Colon (:), comma (,) and s...

2015-02-10 1049 0 0

esProc Assists Report Development – Transpose Operation for Crosstab Creation

It’s difficult to handle unconventional statistical tasks using simply the reporting tool, like Jasper or BIRT, or SQL. One of the cases is that the source data don’t meet the crosstab’s requirements and thus need to be transposed for display. Having powerful computing engine to process structured data and being integr...

2015-02-09 1250 0 0

esProc External Memory Computing: Cross-cellset Cursor

In the article esProc External Memory Computing: Concept of Cursor, we only touched on the basic usage of the cross-cellset cursor. Here we’ll delve into more issues about it. 1. Basic usage The cross-cellset cursor is typically used to handle big data analysis and computing, but it doesn’t impose a minimum limit on da...

2015-02-06 1210 0 0

esProc Program: Set Operators

Since sets are commonly used in esProc, the latter provides comprehensive set operations. 1. Binary Operation on Sets The most basic set in esProc is sequence. Let’s look at some basic binary operations between two sequences A and B. A|B Concatenation: Concatenate the two sequences straightforwardly. The members of B...

2015-02-05 888 0 0

Related Computing in esProc – Primary Keys and Index Function

In an esProc table sequence, a single or multiple fields can be used as a primary key. We can make query based on the primary key using some special functions, which can both simplify the code and increase computational performance effectively. 1. find and pfind Primary keys are common used in database tables. The valu...

2015-02-04 1256 0 0