Oracle ZFS Storage Appliance: Unable To Run Workflow or View Worksheets - aksh: uncaught exception in script: too much recursion

Asset ID:	1-72-2323962.1
Update Date:	2018-01-01
Keywords:

Solution Type Problem Resolution Sure

Solution 2323962.1 : Oracle ZFS Storage Appliance: Unable To Run Workflow or View Worksheets - aksh: uncaught exception in script: too much recursion

Applies to:

PDIT Single Rack ZFS Storage ZS4-4 - Version All Versions and later
Integrated Software for ZFS ZS4-x Arrays - Version All Versions and later
Integrated Software for ZFS ZS5-x Arrays - Version All Versions and later
Oracle ZFS Storage ZS5-4 - Version All Versions and later
Oracle ZFS Storage ZS5-2 - Version All Versions and later
7000 Appliance OS (Fishworks)
5.11 ak/generic@2013.06.05.7.11,1-1.4

Symptoms

Navigating to saved worksheets just presents me with a blank page in the GUI.

In the CLI, it spits out an error that goes back further than my putty's buffer.

Here's a few lines of it, it appears to just repeat itself except for the last section.

(8,(function (ret, err) {if (err) {func(ret, err);throw (err);}total =
total.concat(ret.chunk);if (progress) {nelements = progress(ret);}if (!ret.done) {if
(nelements > 0) {akService.array.chunk(id, nelements, process);} else
{akService.array.chunk(id, process);}} else {func(total,
undefined);}}))@akService.js:59
([object Object],undefined)@../common/akSubr.js:139
(8,(function (ret, err) {if (err) {func(ret, err);throw (err);}total =
total.concat(ret.chunk);if (progress) {nelements = progress(ret);}if (!ret.done) {if
(nelements > 0) {akService.array.chunk(id, nelements, process);} else
{akService.array.chunk(id, process);}} else {func(total,
undefined);}}))@akService.js:59
([object Object])@../common/akSubr.js:139
([object Array],null,-1)@../common/akSubr.js:170
([object Array],undefined)@../common/akSubr.js:72
([object Array],[object Object],(function (ret, err) {if (ret === null || ret ===
undefined) {func(ret, err, erridx);} else {for (i = 0; i < ret.length; i++) {if (ret[i]
instanceof Array) {continue;}ret[i] = akServiceFault(ret[i], stack);if (erridx == -1)
{erridx = i;}if (abort) {func(ret, ret[i], i);return;}}if (erridx == -1) {func(ret,
null, erridx);} else {func(ret, ret[erridx], erridx);}}}))@akService.js:59
akMulticall([object Array],true,(function (ret, err, ndx) {if (err) {func(undefined,
err);throw (err);}id = ret[call.length - 1][0];process(ret[call.length -
2][0]);}))@../common/akSubr.js:52
akChunkcall([object Object])@../common/akSubr.js:163
()@akAnalytics.js:666
()@akNode.js:1273
([object Object],[object Array])@akNode.js:2053
([object Object])@akNode.js:3584
call([object Object],[object Object])@:0
(2,(function (child) {return (parent.runChild(child, input.slice(1)));}))@akNode.js:517
("worksheets","static",(function (child) {return (parent.runChild(child,
input.slice(1)));}),(function () {akshError(EAKSH_BADCMD, orig.join("
"));}))@akNode.js:658
("worksheets",(function (child) {return (parent.runChild(child,
input.slice(1)));}),(function () {akshError(EAKSH_BADCMD, orig.join("
"));}))@akNode.js:739
([object Array],(function () {akshError(EAKSH_BADCMD, orig.join(" "));}))@akNode.js:3585
([object Array])@akNode.js:3710
([object Array])@akInterpreter.js:1390
([object Array])@akInterpreter.js:1602
()@akInterpreter.js:2095
()@akInterpreter.js:2198
@/usr/lib/ak/js/shell/akLocore.js:631

Changes

Possible script in PDIT modifying/updating worksheet PDITLatency.

Cause

Possible corrupt worksheet.

Found a worksheet that has 14965 lines in it.

Stash Object:
nvlist version: 0
_class = com/sun/ak/xmlrpc/object
_version = 0x1
_atom = obj
type = worksheet
name = PDITLatency
uuid = f63f369b-29a4-e2ef-8730-e54d6cf0d622

# aknv f63f369b-29a4-e2ef-8730-e54d6cf0d622/obj | wc -l
14965

Solution

Recommended action for the customer:

You will need to engage Oracle Support, by opening a Service Request, so that Oracle Support Services can provide confirmation of this issue and then carry out the appropriate activities to identify the corrupt worksheet in question, and remove it.

Recommended actions for the Oracle Support engineer:

Destroy a corrupt Analytics worksheet in a cluster - see the following wiki document:

https://stbeehive.oracle.com/teamcollab/wiki/AmberRoadSupport:Destroying+a+corrupt+Analytics+worksheet+in+a+cluster

If you cannot access this document engage NAS Storage-TSC for assistance

References

<BUG:26497198> - "ANALYTICS WORKSHEET" FAILS WITH 'TOO MUCH RECURSION' DUE TO DUPLICATE DATASETS
<BUG:27043441> - WORKFLOW FAILS AND LISTING OF WORKSHEETS FAIL UNCAUGHT EXCEPTION IN SCRIPT
<BUG:19013922> - WORKSHEET WITH LARGE AMOUNT OF DUPLICATE DATASETS CAUSES TOO MUCH RECURSION ERR
<NOTE:1416406.1> - Sun ZFS Storage Appliances Troubleshooting Resource Center
<BUG:15513816> - SUNBT6757192 AKCHUNKCALL CAN RECURSE TOO FAR IN CLI
<BUG:19237157> - LIMIT NUMBER OF DATASETS IN A SINGLE WORKSHEET TO <= 1000

Attachments

This solution has no attachment