TensorFlow.js in Node.js

This guide describes the TensorFlow.js packages and APIs available for Node.js.

To learn how to install TensorFlow.js in Node.js, see the setup tutorial. For additional information on installation and support, see the TensorFlow.js for Node.js repository.

TensorFlow CPU

The TensorFlow CPU package can be imported as follows:

import*astffrom'@tensorflow/tfjs-node'

When you import TensorFlow.js from this package, you get a module that's accelerated by the TensorFlow C binary and runs on the CPU. TensorFlow on the CPU uses hardware acceleration to optimize linear algebra computation.

This package works on Linux, Windows, and macOS platforms where TensorFlow is supported.

TensorFlow GPU

The TensorFlow GPU package can be imported as follows:

import*astffrom'@tensorflow/tfjs-node-gpu'

Like the CPU package, the module is accelerated by the TensorFlow C binary. But the GPU package runs tensor operations on the GPU with CUDA, so it's only available on Linux. This binding can be at least an order of magnitude faster than the other binding options.

TensorFlow for pure JavaScript

There's also a version of TensorFlow.js that runs pure JavaScript on the CPU. It can be imported as follows:

import*astffrom'@tensorflow/tfjs'

This package is the same package that you'd use in the browser. In this package, the operations are run in vanilla JavaScript on the CPU. This package is much smaller than the others because it doesn't need the TensorFlow binary, but it's also much slower.

Because this package doesn't rely on TensorFlow, it can be used in more devices that support Node.js. It's not limited to the Linux, Windows, and macOS platforms that support TensorFlow.

Production considerations

The Node.js bindings provide a backend for TensorFlow.js that implements operations synchronously. This means that, for example, when you call an operation like tf.matMul(a, b), it will block the main thread until the operation has completed.

For this reason, the bindings are well suited for scripts and offline tasks. If you want to use the Node.js bindings in a production application like a web server, you should set up a job queue or set up worker threads so your TensorFlow.js code doesn't block the main thread.

APIs

When you import the package as tf using any of the options above, all of the normal TensorFlow.js symbols appear on the imported module.

tf.browser

The APIs in the tf.browser.* namespace are not usable in Node.js because they depend on browser-specific APIs. For a list of the tf.browser APIs, see Browser.

tf.node

The two Node.js packages also provide a namespace, tf.node, which contains Node.js-specific APIs (for example, TensorBoard).

Here's an example of exporting summaries to TensorBoard in Node.js:

constmodel=tf.sequential();
model.add(tf.layers.dense({units:1,inputShape:[200]}));
model.compile({
loss:'meanSquaredError',
optimizer:'sgd',
metrics:['MAE']
});
// Generate some random fake data for demo purposes.
constxs=tf.randomUniform([10000,200]);
constys=tf.randomUniform([10000,1]);
constvalXs=tf.randomUniform([1000,200]);
constvalYs=tf.randomUniform([1000,1]);
// Start model training process.
asyncfunctiontrain(){
awaitmodel.fit(xs,ys,{
epochs:100,
validationData:[valXs,valYs],
// Add the tensorBoard callback here.
callbacks:tf.node.tensorBoard('/tmp/fit_logs_1')
});
}
train();