first updates (#25)

hpccsystems-solutions-lab · Sep 28, 2023 · 065dd49 · 065dd49
1 parent 34108ff
commit 065dd49
Show file tree

Hide file tree

Showing 9 changed files with 1,588 additions and 0 deletions.
diff --git a/learnEcl/1400-filter.md b/learnEcl/1400-filter.md
@@ -2,3 +2,185 @@
 title: Filter
 slug: filter
 ---
+
+# FILTER
+
+Data filtering is the process of choosing a smaller part of your data set and using that subset for further processing. It’s recommended to filter down to the desire dataset before any processing. When using filter on STRING values keep in mind that STRING values are case sensitive. For example Sun, sun, SUN are not the same.
+
+## SQL vs. ECL
+
+Filter is similar to SELECT. In ECL the filtering fields are in ( ).
+<pre>
+<EclCode code="// SQL 
+SELECT name, address FROM PeopleDS WHERE name = 'Jo';
+
+// ECL
+OUTPUT(peopleDS(name = 'Jo'));">
+</EclCode>
+</pre>
+
+## Syntax
+
+<pre>
+<EclCode code="attr_name := dataset_name (filtering condition(s));">
+</EclCode>
+</pre>
+
+| _Value_ | _Definition_ |
+| :- | :- |
+| attr_name | The name by which the function will be invoked. |
+| dataset_name | The dataset to perform action on. |
+| Filtering condition(s) | Field or fields and required filtering conditions. Logical operators can be used to execute multiple filters. |
+
+### Demo Dataset
+
+| PersonID | FirstName | LastName | isEmployed | avgHouseIncome |
+| :- | :- | :- | :- | :- |
+| 102 | Fred | Smith | FALSE | 0 |
+| 012 | Joe | Blow | TRUE | 11250 |
+| 085 | Blue | Moon | TRUE | 185000 |
+| 055 | Silver | Jo | FALSE | 5000 |
+| 265 | Darling | Jo | TRUE | 5000 |
+| 333 | Jane | Smith | FALSE | 50000 |
+
+**Example**
+
+<pre>
+<EclCode
+id="FilterExp_1"
+tryMe="FilterExp_1"
+code="/*Filter Example:*/
+
+/*
+FILTER Example:
+Showing different examples of FILTER function 
+based on different fields or logical operator.
+*/
+
+// Creating record layout
+Emp_layout := RECORD
+    INTEGER  PersonID; 
+    STRING   FirstName; 
+    STRING   LastName; 
+    BOOLEAN  IsEmp;
+    INTEGER  RoundedIncome;
+END; 
+
+// Creating an inline dataset
+Emp_DS := DATASET([
+                {102,'Fred','Smith',FALSE,0},
+                {012,'Joe','Blow',TRUE,11250},
+                {085,'Blue','Moon',TRUE,185000},
+                {055,'Silver','Jo',FALSE,5000},
+                {265,'Darling','Jo',TRUE,5000},
+                {333,'Jane','Smith',FALSE,50000}],
+                Emp_layout);
+
+// Filter Smith last name
+GetSmith := Emp_DS(LastName='Smith');
+OUTPUT(GetSmith, NAMED('GetSmith'));
+
+// Notice that following filter will return an empty dataset
+OUTPUT(Emp_DS(LastName='smith'), NAMED('Case_Sensitive'));
+
+
+// Filter unemployed with income using logical operators
+IsWorking := Emp_DS(IsEmp = FALSE AND
+                    RoundedIncome > 0);
+
+OUTPUT(IsWorking, NAMED('IsWorking'));
+
+// Capturing everyone that is employed 
+// Following filter is the same as: 
+// Emp_DS(IsEmp = TRUE)
+OUTPUT(Emp_DS(IsEmp), NAMED('Employed'));
+
+"></EclCode>
+</pre>
+
+## Logical Operators
+
+| Operator | Description |
+| :- | :- |
+| = | Equal |
+| > | Greater than |
+| &lt; | Something |
+| >= | Greater than or equal |
+| &lt;= | Less than or equal |
+| &lt;> | Not equal |
+| != | Not equal |
+| AND | Logical AND |
+| OR | Logical OR |
+| IN | To specify multiple possible values for a field/column. |
+| NOT IN | To specify multiple possible values that are not in a field/column. |
+| BETWEEN | Between a certain range. |
+
+**Example**
+
+<pre>
+<EclCode
+id="FilterExp_2"
+tryMe="FilterExp_2"
+code="/*
+Filter Example
+*/
+
+StrokeRec := RECORD
+    STRING   ID;	
+    STRING   Gender;	
+    INTEGER  Age;	
+    BOOLEAN  Hypertension;	
+    BOOLEAN  Heart_Disease;	
+    STRING   Ever_Married;	
+    STRING   Work_Type;	
+    STRING   Residence_Type;	
+    STRING   Avg_Glucose_Level;	
+    STRING   BMI;	
+    STRING   Smoking_status;	
+    BOOLEAN  Stroke;
+END;
+
+
+StrokeDS := DATASET('~raw::healthcare-dataset-stroke-data.csv', StrokeRec, CSV(HEADING(1)));
+
+// Filtering men over age of 80
+Over80 := StrokeDS(Age >= 80);
+OUTPUT(Over80, NAMED('Over80'));
+
+
+
+"></EclCode>
+</pre>
+
+<pre>
+<EclCode
+id="FilterExp_3"
+tryMe="FilterExp_3"
+code="/*
+Filter Example
+*/
+
+StrokRec := RECORD
+    STRING   ID;	
+    STRING   Gender;	
+    INTEGER  Age;	
+    BOOLEAN  Hypertension;	
+    BOOLEAN  Heart_Disease;	
+    STRING   Ever_Married;	
+    STRING   Work_Type;	
+    STRING   Residence_Type;	
+    STRING   Avg_Glucose_Level;	
+    STRING   BMI;	
+    STRING   Smoking_status;	
+    BOOLEAN  Stroke;
+END;
+
+
+StrokDS := DATASET('~raw::healthcare-dataset-stroke-data.csv', StrokRec, CSV(HEADING(1)));
+
+// Over 80 years old men with heart disease 
+OUTPUT(StrokDS(Gender = 'Male' AND Age >= 80 AND Heart_Disease), NAMED('Males'));
+
+
+"></EclCode>
+</pre>
diff --git a/learnEcl/2200-sample.md b/learnEcl/2200-sample.md
@@ -2,3 +2,69 @@
 title: Sample
 slug: sample
 ---
+
+# SAMPLE
+
+SAMPLE function returns a sample set of dataset. Returned value is a dataset.
+
+## Syntax
+
+<pre>
+<EclCode code="SAMPLE(dataset, interval, [, which])">
+</EclCode>
+</pre>
+
+| _Value_ | _Definition_ |
+| :- | :- |
+| dataset | Input dataset to process. |
+| interval | The intervals between records to return. |
+| which | Optional. An integer specifying the ordinal number of the sample set to return. This is used to obtain multiple non-overlapping samples from the same recordset. |
+
+### Demo Dataset
+| Color | ID |
+| :- | :- |
+| Red | 100 |
+| Blue | 102 |
+| Black | 103 |
+| Yellow | 104 |
+| Orange | 105 |
+| White | 106 |
+| Green | 107 |
+| Purple | 108 |
+
+**Example**
+
+<pre>
+<EclCode
+id="SampleExp_1"
+tryMe="SampleExp_1"
+code="/*Sample Example:*/
+
+/*
+REAL Example:
+Collecting different sample sizes from the input dataset.
+*/
+
+Color_Layout := RECORD
+    STRING   Color;
+    INTEGER ID;
+END;
+
+Color_DS := DATASET([
+    {'Red', 100},
+    {'Blue', 102},
+    {'Black', 103},
+    {'Yellow', 104},
+    {'Orange', 105},
+    {'White', 106},
+    {'Green', 107},
+    {'Purple', 108}],
+    Color_Layout);
+
+SampleOne := SAMPLE(Color_DS, 3);
+OUTPUT(SampleOne, NAMED('SampleOne'));
+
+SAMPLE(Color_DS, 2, 4);
+
+"></EclCode>
+</pre>