Browsed by
Tag: suitescript

Boost Efficiency: Convert Large Netsuite CSVs to Excel XLSX

Boost Efficiency: Convert Large Netsuite CSVs to Excel XLSX

I faced a challenging project that involved converting large CSV files stored in Netsuite’s file cabinet into XLSX format, specifically in Excel files. These files varied in size, with some exceeding 30 MB and even 100 MB. Initially, I attempted to use SheetJS, a plugin designed for this purpose (https://docs.sheetjs.com/docs/demos/cloud/netsuite/). However, I encountered difficulties as the plugin loaded the entire CSV file into memory, causing errors and performance issues.

To overcome this limitation, I devised an alternative solution for converting the CSV files to Excel XLSX format. My approach involved iterating through the CSV file line by line and constructing the XLSX file from scratch. Leveraging the fact that XLSX files are essentially zip files containing multiple XML files, I successfully accomplished the conversion. As a result, not only were the CSV files successfully converted, but the resulting XLSX files also demonstrated significant reductions in file size. In some cases, file sizes were reduced by up to 50%.

However, it is important to be aware of certain caveats associated with this conversion method. There are instances where the size of the resulting ZIP file becomes too large to compress, leading to a failure in the conversion process and triggering a timeout error. The exact threshold for this issue is not specified, as I have encountered failures with files around 50 MB, while others as large as 200 MB were processed without any problems. Consequently, it is crucial to consider the possibility of encountering heavy files that may not be compatible with this code. For optimal processing power, it is advisable to execute the code as a Schedule/Mass Reduce script.

 

To utilize the function effectively, ensure you are running it on Suitescript 2.1 and that the following modules are loaded: “N/xml,” “N/file,” and “N/compress.”

Simply provide the function with the File Cabinet path of the CSV file, and it will seamlessly transform it into an Excel file, preserving both the original file name and folder location.
Eg:

 

11 Secret Suitescript 2.1 Features That Reptilians Don’t Want You To Know

11 Secret Suitescript 2.1 Features That Reptilians Don’t Want You To Know

Suitescript 2.1 is out of beta and beginning on 2021.1 release all Suitescript 2.x scripts will be running as Suitescript 2.1 so better test your existing scripts for any bugs.

To change your scripts to use Suitescript 2.1 all you have to do is change this JSTag:

From:

To:

It’s also worth mentioning that as of today Suitescript 2.1 is not available for client scripts yet so bear that in mind.


“let” keyword:

This is basically a super local variable, it’s very useful for using them in for loops. Now you can have multiple nested for loops and declare all of your loop counter variables “i” and not worry about conflicts.

Example

Using var:

Using let:

For details check out w3schools.

 


“for of” statement

This is another way to loop through an array, I find it easier to write although it only works on iterables so this means it doesn’t work on objects as opposed to “for in” which works on both objects and arrays.

Example

Considering:

Using “for in”:

Using “for of”:

This looks more elegant to me, but you be the judge.

For details check out w3schools.


String includes() Method

If you are like me and hate the sight of using .search() or regex to check if a string includes some text then you need this in your life.

Example

Considering the following string:

Using search method:

Using includes method:

So your code would end up looking like this:

Holy molly, this was long overdue. I love this and will be using it very oftenly.

For details check out w3schools.


Array includes() Method

This is the same thing as the previous example with String includes() method. I find it easier and more elegant than using Array indexOf.

Example

Considering the following string:

Using indexOf method:

Using includes method:

For details check out w3schools.


Array every() Method

This method is useful for validating if all of the elements of the array meet certain condition, if one of them doesn’t meet the condition then it returns false.

Example

For details check out w3schools.


Set Object

The set object is a list of unique values of any type. This is very useful for removing duplicates from an Array.

Example

Here’s another example

It has several methods you can use like: add, size, has, forEach, delete and clear so it makes a powerful tool by itself. Sets also outperforms Arrays so that’s another reason to love it.

For details check out Alligator.io and  Mozilla Docs.


Spread syntax

This is basically used to expand an array or compact several parameters into an array.

Examples

Useful for concatenating two arrays like:

Or making copies of arrays like:

For details and more uses check out Scotch.io and  Mozilla Docs.


Template literals (Template strings)

This is a life changer. You can now use backtick characters (`)  to have more freedom when defining strings, they also support placeholders and multi-line strings!

Example

Using string concatenation:

Using template literals:
The output is the same:
For details and more uses check out Mozilla Docs.

 


Arrow functions

These functions work the same as regular functions but have a more compact syntax.

Example

Regular function:

Arrow function:

And it can get even shorter:

Anonymous arrow function with params:
For details and more uses check out w3schools.

Serverside promises

Promises are now supported serverside so you can now write asynchronous code.

Example

You can also create your own Promises now like so:

For details and more uses check out Mozilla Docs.

 


Async functions (Async/Await)

Async functions provide a way to structure and simplify your asynchronous code. I find this very useful to avoid callback hell that comes with Promises as it can get pretty complex, I have seen some code where there’s an unending statements of .then.then.then….. in a row.

Example

For details and more uses check out Mozilla Docs.

 


 

So what do you think? Do you agree with our list? Share your comments below.

Downloading Suitescript APIs To Enable Code Assist

Downloading Suitescript APIs To Enable Code Assist

Having Suitescript API javascript files available locally is useful for enabling code assist features in some IDE’s like Eclipse and Brackets. To download the files just head to Netsuite’s File Cabinet and you will find the files right above the “Delete Files” button:

More info on how to integrate it with your IDE available here.