Benchmark: (ColorfulCakeChen) CNN Embedding (50c1b285ff7c7f8c656c388365b4043528642d6b) 182

(ColorfulCakeChen) CNN Embedding (50c1b285ff7c7f8c656c388365b4043528642d6b) 182 (version: 182)

Comparing performance of: Async wait for init (WASM) vs (WASM) AddGatherReshape_channelMultiplier_1 vs (WASM) SplitReshapeGatherConcat_channelMultiplier_1 vs (WASM) AddGatherReshape_channelMultiplier_2 vs (WASM) SplitReshapeGatherConcat_channelMultiplier_2 vs (WASM) AddGatherReshape_channelMultiplier_4 vs (WASM) SplitReshapeGatherConcat_channelMultiplier_4 vs (WASM) AddGatherReshape_channelMultiplier_8 vs (WASM) SplitReshapeGatherConcat_channelMultiplier_8 vs Async wait for init (WebGL) vs (WebGL) AddGatherReshape_channelMultiplier_1 vs (WebGL) SplitReshapeGatherConcat_channelMultiplier_1 vs (WebGL) AddGatherReshape_channelMultiplier_2 vs (WebGL) SplitReshapeGatherConcat_channelMultiplier_2 vs (WebGL) AddGatherReshape_channelMultiplier_4 vs (WebGL) SplitReshapeGatherConcat_channelMultiplier_4 vs (WebGL) AddGatherReshape_channelMultiplier_8 vs (WebGL) SplitReshapeGatherConcat_channelMultiplier_8 vs (WebGL) 9 vs (WebGL) 10 vs (WebGL) 11 vs (WebGL) 12 vs (WebGL) 13 vs (WebGL) 14 vs (WebGL) 15 vs (WebGL) 16 vs (WebGL) 17 vs (WebGL) 18 vs Async wait for init (CPU) vs (CPU) AddGatherReshape_channelMultiplier_1 vs (CPU) SplitReshapeGatherConcat_channelMultiplier_1 vs (CPU) AddGatherReshape_channelMultiplier_2 vs (CPU) SplitReshapeGatherConcat_channelMultiplier_2 vs (CPU) AddGatherReshape_channelMultiplier_4 vs (CPU) SplitReshapeGatherConcat_channelMultiplier_4 vs (CPU) AddGatherReshape_channelMultiplier_8 vs (CPU) SplitReshapeGatherConcat_channelMultiplier_8 vs (CPU) 9 vs (CPU) 10 vs (CPU) 11 vs (CPU) 12 vs (CPU) 13 vs (CPU) 14 vs (CPU) 15 vs (CPU) 16 vs (CPU) 17 vs (CPU) 18

Created: 3 years ago by: Registered User

Jump to the latest result

HTML Preparation code:

<script src="https://cdn.jsdelivr.net/npm/@tensorflow/tfjs@4.8.0/dist/tf.min.js"></script>
<script src="https://cdn.jsdelivr.net/npm/@tensorflow/tfjs-backend-wasm/dist/tf-backend-wasm.js"></script>

Script Preparation code:

globalThis.backendName_testing = undefined;
globalThis.jsPerf_Module = undefined;
globalThis.testCorrectnessIterator = undefined;

async function init( backendName ) {
  if ( !globalThis.jsPerf_Module ) {
    console.log( "import jsPerf_Embedding..." );
    globalThis.jsPerf_Module = await import(
      "https://cdn.jsdelivr.net/gh/colorfulcakechen/query-submit-canvas@50c1b285ff7c7f8c656c388365b4043528642d6b/CNN/jsPerf/jsPerf_Embedding.js" );
  }

  if ( backendName_testing != backendName ) {
    console.log( `Change backend to "${backendName}"...` );
    globalThis.backendName_testing = backendName;

    globalThis.jsPerf_Module.disposeResources();

    await tf.ready();
    await tf.setBackend( backendName );

    globalThis.jsPerf_Module.init();
  	globalThis.testCorrectnessIterator = jsPerf_Module.testCorrectness();
  }

  if ( !globalThis.testCorrectnessIterator )
    return true;

  let testCorrectnessYield = globalThis.testCorrectnessIterator.next();
  if ( testCorrectnessYield.done ) {
    console.log( `${backendName}, initialization done.` );
    globalThis.testCorrectnessIterator = null;
    return true;
  } else {
	return false;
  }
}

Tests:

Async wait for init (WASM)
if ( ( globalThis.initPromiseWASM ) && ( globalThis.initPromiseWebGL ) && ( globalThis.initPromiseCPU ) ) { // For benchmark re-run. globalThis.initPromiseWASM = globalThis.initPromiseWebGL = globalThis.initPromiseCPU = null; } const backendName = "wasm"; //const backendName = "webgl"; //const backendName = "cpu"; if ( !globalThis.initPromiseWASM ) { globalThis.initPromiseWASM = init( backendName ); } else { globalThis.initPromiseWASM.then( ( done ) => { if ( !done ) { globalThis.initPromiseWASM = init( backendName ); } else { } }); }
(WASM) AddGatherReshape_channelMultiplier_1
globalThis.testSet_108x192x4.testEmbedding_ByName( "AddGatherReshape_channelMultiplier_1" );
(WASM) SplitReshapeGatherConcat_channelMultiplier_1
globalThis.testSet_108x192x4.testEmbedding_ByName( "SplitReshapeGatherConcat_channelMultiplier_1" );
(WASM) AddGatherReshape_channelMultiplier_2
globalThis.testSet_108x192x4.testEmbedding_ByName( "AddGatherReshape_channelMultiplier_2" );
(WASM) SplitReshapeGatherConcat_channelMultiplier_2
globalThis.testSet_108x192x4.testEmbedding_ByName( "SplitReshapeGatherConcat_channelMultiplier_2" );
(WASM) AddGatherReshape_channelMultiplier_4
globalThis.testSet_108x192x4.testEmbedding_ByName( "AddGatherReshape_channelMultiplier_4" );
(WASM) SplitReshapeGatherConcat_channelMultiplier_4
globalThis.testSet_108x192x4.testEmbedding_ByName( "SplitReshapeGatherConcat_channelMultiplier_4" );
(WASM) AddGatherReshape_channelMultiplier_8
globalThis.testSet_108x192x4.testEmbedding_ByName( "AddGatherReshape_channelMultiplier_8" );
(WASM) SplitReshapeGatherConcat_channelMultiplier_8
globalThis.testSet_108x192x4.testEmbedding_ByName( "SplitReshapeGatherConcat_channelMultiplier_8" );
Async wait for init (WebGL)
const backendName = "webgl"; if ( !globalThis.initPromiseWebGL ) { globalThis.initPromiseWebGL = init( backendName ); } else { globalThis.initPromiseWebGL.then( ( done ) => { if ( !done ) { globalThis.initPromiseWebGL = init( backendName ); } else { } }); }
(WebGL) AddGatherReshape_channelMultiplier_1
globalThis.testSet_108x192x4.testEmbedding_ByName( "AddGatherReshape_channelMultiplier_1" );
(WebGL) SplitReshapeGatherConcat_channelMultiplier_1
globalThis.testSet_108x192x4.testEmbedding_ByName( "SplitReshapeGatherConcat_channelMultiplier_1" );
(WebGL) AddGatherReshape_channelMultiplier_2
globalThis.testSet_108x192x4.testEmbedding_ByName( "AddGatherReshape_channelMultiplier_2" );
(WebGL) SplitReshapeGatherConcat_channelMultiplier_2
globalThis.testSet_108x192x4.testEmbedding_ByName( "SplitReshapeGatherConcat_channelMultiplier_2" );
(WebGL) AddGatherReshape_channelMultiplier_4
globalThis.testSet_108x192x4.testEmbedding_ByName( "AddGatherReshape_channelMultiplier_4" );
(WebGL) SplitReshapeGatherConcat_channelMultiplier_4
globalThis.testSet_108x192x4.testEmbedding_ByName( "SplitReshapeGatherConcat_channelMultiplier_4" );
(WebGL) AddGatherReshape_channelMultiplier_8
globalThis.testSet_108x192x4.testEmbedding_ByName( "AddGatherReshape_channelMultiplier_8" );
(WebGL) SplitReshapeGatherConcat_channelMultiplier_8
globalThis.testSet_108x192x4.testEmbedding_ByName( "SplitReshapeGatherConcat_channelMultiplier_8" );
(WebGL) 9
9;
(WebGL) 10
10;
(WebGL) 11
11;
(WebGL) 12
12;
(WebGL) 13
13;
(WebGL) 14
14;
(WebGL) 15
15;
(WebGL) 16
16;
(WebGL) 17
17;
(WebGL) 18
18;
Async wait for init (CPU)
const backendName = "cpu"; if ( !globalThis.initPromiseCPU ) { globalThis.initPromiseCPU = init( backendName ); } else { globalThis.initPromiseCPU.then( ( done ) => { if ( !done ) { globalThis.initPromiseCPU = init( backendName ); } else { } }); }
(CPU) AddGatherReshape_channelMultiplier_1
globalThis.testSet_108x192x4.testEmbedding_ByName( "AddGatherReshape_channelMultiplier_1" );
(CPU) SplitReshapeGatherConcat_channelMultiplier_1
globalThis.testSet_108x192x4.testEmbedding_ByName( "SplitReshapeGatherConcat_channelMultiplier_1" );
(CPU) AddGatherReshape_channelMultiplier_2
globalThis.testSet_108x192x4.testEmbedding_ByName( "AddGatherReshape_channelMultiplier_2" );
(CPU) SplitReshapeGatherConcat_channelMultiplier_2
globalThis.testSet_108x192x4.testEmbedding_ByName( "SplitReshapeGatherConcat_channelMultiplier_2" );
(CPU) AddGatherReshape_channelMultiplier_4
globalThis.testSet_108x192x4.testEmbedding_ByName( "AddGatherReshape_channelMultiplier_4" );
(CPU) SplitReshapeGatherConcat_channelMultiplier_4
globalThis.testSet_108x192x4.testEmbedding_ByName( "SplitReshapeGatherConcat_channelMultiplier_4" );
(CPU) AddGatherReshape_channelMultiplier_8
globalThis.testSet_108x192x4.testEmbedding_ByName( "AddGatherReshape_channelMultiplier_8" );
(CPU) SplitReshapeGatherConcat_channelMultiplier_8
globalThis.testSet_108x192x4.testEmbedding_ByName( "SplitReshapeGatherConcat_channelMultiplier_8" );
(CPU) 9
9;
(CPU) 10
10;
(CPU) 11
11;
(CPU) 12
12;
(CPU) 13
13;
(CPU) 14
14;
(CPU) 15
15;
(CPU) 16
16;
(CPU) 17
17;
(CPU) 18
18;

Rendered benchmark preparation results:

Suite status: <idle, ready to run>

Previous results

Test case name	Result
Async wait for init (WASM)
(WASM) AddGatherReshape_channelMultiplier_1
(WASM) SplitReshapeGatherConcat_channelMultiplier_1
(WASM) AddGatherReshape_channelMultiplier_2
(WASM) SplitReshapeGatherConcat_channelMultiplier_2
(WASM) AddGatherReshape_channelMultiplier_4
(WASM) SplitReshapeGatherConcat_channelMultiplier_4
(WASM) AddGatherReshape_channelMultiplier_8
(WASM) SplitReshapeGatherConcat_channelMultiplier_8
Async wait for init (WebGL)
(WebGL) AddGatherReshape_channelMultiplier_1
(WebGL) SplitReshapeGatherConcat_channelMultiplier_1
(WebGL) AddGatherReshape_channelMultiplier_2
(WebGL) SplitReshapeGatherConcat_channelMultiplier_2
(WebGL) AddGatherReshape_channelMultiplier_4
(WebGL) SplitReshapeGatherConcat_channelMultiplier_4
(WebGL) AddGatherReshape_channelMultiplier_8
(WebGL) SplitReshapeGatherConcat_channelMultiplier_8
(WebGL) 9
(WebGL) 10
(WebGL) 11
(WebGL) 12
(WebGL) 13
(WebGL) 14
(WebGL) 15
(WebGL) 16
(WebGL) 17
(WebGL) 18
Async wait for init (CPU)
(CPU) AddGatherReshape_channelMultiplier_1
(CPU) SplitReshapeGatherConcat_channelMultiplier_1
(CPU) AddGatherReshape_channelMultiplier_2
(CPU) SplitReshapeGatherConcat_channelMultiplier_2
(CPU) AddGatherReshape_channelMultiplier_4
(CPU) SplitReshapeGatherConcat_channelMultiplier_4
(CPU) AddGatherReshape_channelMultiplier_8
(CPU) SplitReshapeGatherConcat_channelMultiplier_8
(CPU) 9
(CPU) 10
(CPU) 11
(CPU) 12
(CPU) 13
(CPU) 14
(CPU) 15
(CPU) 16
(CPU) 17
(CPU) 18

Fastest: N/A

Slowest: N/A

Latest run results:

Run details: (Test run date: one year ago)

User agent: Mozilla/5.0 (X11; CrOS x86_64 14541.0.0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/114.0.0.0 Safari/537.36

Browser/OS: Chrome 114 on Chrome OS 14541.0.0

View result in a separate tab

Test name	Executions per second
Async wait for init (WASM)	361871.3 Ops/sec
(WebGL) 16	371511520.0 Ops/sec
(WebGL) 17	387994272.0 Ops/sec
(WebGL) 18	300750336.0 Ops/sec
Async wait for init (CPU)	866009.6 Ops/sec
(CPU) AddGatherReshape_channelMultiplier_1	207237.2 Ops/sec
(CPU) SplitReshapeGatherConcat_channelMultiplier_1	8.3 Ops/sec
(CPU) AddGatherReshape_channelMultiplier_2	18.7 Ops/sec
(CPU) SplitReshapeGatherConcat_channelMultiplier_2	8.3 Ops/sec
(CPU) AddGatherReshape_channelMultiplier_4	13.9 Ops/sec
(WebGL) 15	393218752.0 Ops/sec
(CPU) SplitReshapeGatherConcat_channelMultiplier_4	6.9 Ops/sec
(CPU) SplitReshapeGatherConcat_channelMultiplier_8	4.9 Ops/sec
(CPU) 9	370838752.0 Ops/sec
(CPU) 10	385098336.0 Ops/sec
(CPU) 11	355921824.0 Ops/sec
(CPU) 12	336296736.0 Ops/sec
(CPU) 13	365277632.0 Ops/sec
(CPU) 14	389340384.0 Ops/sec
(CPU) 15	362516128.0 Ops/sec
(CPU) 16	352168064.0 Ops/sec
(CPU) AddGatherReshape_channelMultiplier_8	7.5 Ops/sec
(CPU) 17	35227732.0 Ops/sec
(WebGL) 14	372417024.0 Ops/sec
(WebGL) 12	340823712.0 Ops/sec
(WASM) AddGatherReshape_channelMultiplier_1	19907.0 Ops/sec
(WASM) SplitReshapeGatherConcat_channelMultiplier_1	20.8 Ops/sec
(WASM) AddGatherReshape_channelMultiplier_2	16.2 Ops/sec
(WASM) SplitReshapeGatherConcat_channelMultiplier_2	17.3 Ops/sec
(WASM) AddGatherReshape_channelMultiplier_4	13.9 Ops/sec
(WASM) SplitReshapeGatherConcat_channelMultiplier_4	12.9 Ops/sec
(WASM) AddGatherReshape_channelMultiplier_8	7.9 Ops/sec
(WASM) SplitReshapeGatherConcat_channelMultiplier_8	6.7 Ops/sec
Async wait for init (WebGL)	803881.6 Ops/sec
(WebGL) 13	345887008.0 Ops/sec
(WebGL) AddGatherReshape_channelMultiplier_1	179819.9 Ops/sec
(WebGL) AddGatherReshape_channelMultiplier_2	995.4 Ops/sec
(WebGL) SplitReshapeGatherConcat_channelMultiplier_2	320.8 Ops/sec
(WebGL) AddGatherReshape_channelMultiplier_4	1080.6 Ops/sec
(WebGL) SplitReshapeGatherConcat_channelMultiplier_4	274.4 Ops/sec
(WebGL) AddGatherReshape_channelMultiplier_8	889.9 Ops/sec
(WebGL) SplitReshapeGatherConcat_channelMultiplier_8	170.3 Ops/sec
(WebGL) 9	349426656.0 Ops/sec
(WebGL) 10	336338144.0 Ops/sec
(WebGL) 11	375478688.0 Ops/sec
(WebGL) SplitReshapeGatherConcat_channelMultiplier_1	364.6 Ops/sec
(CPU) 18	382508000.0 Ops/sec

Autogenerated LLM Summary (model llama3.2:3b, generated one month ago):

LLMs can make mistakes. Check important info.

Related benchmarks:

(ColorfulCakeChen) CNN Embedding (50c1b285ff7c7f8c656c388365b4043528642d6b) 182 (version: 182)

Created: 3 years ago by: Registered User

Jump to the latest result

Async wait for init (WASM)

(WASM) AddGatherReshape_channelMultiplier_1

(WASM) SplitReshapeGatherConcat_channelMultiplier_1

(WASM) AddGatherReshape_channelMultiplier_2

(WASM) SplitReshapeGatherConcat_channelMultiplier_2

(WASM) AddGatherReshape_channelMultiplier_4

(WASM) SplitReshapeGatherConcat_channelMultiplier_4

(WASM) AddGatherReshape_channelMultiplier_8

(WASM) SplitReshapeGatherConcat_channelMultiplier_8

Async wait for init (WebGL)

(WebGL) AddGatherReshape_channelMultiplier_1

(WebGL) SplitReshapeGatherConcat_channelMultiplier_1

(WebGL) AddGatherReshape_channelMultiplier_2

(WebGL) SplitReshapeGatherConcat_channelMultiplier_2

(WebGL) AddGatherReshape_channelMultiplier_4

(WebGL) SplitReshapeGatherConcat_channelMultiplier_4

(WebGL) AddGatherReshape_channelMultiplier_8

(WebGL) SplitReshapeGatherConcat_channelMultiplier_8

(WebGL) 9

(WebGL) 10

(WebGL) 11

(WebGL) 12

(WebGL) 13

(WebGL) 14

(WebGL) 15

(WebGL) 16

(WebGL) 17

(WebGL) 18

Async wait for init (CPU)

(CPU) AddGatherReshape_channelMultiplier_1

(CPU) SplitReshapeGatherConcat_channelMultiplier_1

(CPU) AddGatherReshape_channelMultiplier_2

(CPU) SplitReshapeGatherConcat_channelMultiplier_2

(CPU) AddGatherReshape_channelMultiplier_4

(CPU) SplitReshapeGatherConcat_channelMultiplier_4

(CPU) AddGatherReshape_channelMultiplier_8

(CPU) SplitReshapeGatherConcat_channelMultiplier_8

(CPU) 9

(CPU) 10

(CPU) 11

(CPU) 12

(CPU) 13

(CPU) 14

(CPU) 15

(CPU) 16

(CPU) 17

(CPU) 18

Suite status: <idle, ready to run>

Experimental features:

Fastest: N/A

Slowest: N/A

Autogenerated LLM Summary (model llama3.2:3b, generated one month ago):