Let’s write our first controller middleware unit test by mocking out a database call and verifying that the database is interacted with correctly and the response is sent correctly.

Test Node.js Backends

Write a Unit Test for a Controller by Mocking the Database

Instructor: [00:01] All right, so we want to test the `getListItem` function, which itself is pretty simple. It calls the `res.json`, but it also calls into this `expandBookData` function, which is going to call `booksDB.readById`.

#### list-items-controller.js

```javascript
async function getListItem(req, res) {
  res.json({ listItem: await expandBookData(req.listItem) });
}

async function expandBookData(listItem) {
  const book = await booksDB.readById(listItem.bookId);
  return { ...listItem, book };
}
```

We do need to mock that out, because we don't want to interact with the database in this test.

[00:20] Let's follow along with the emoji here. We do need a couple of the generators from `utils/generate`. We could import it like this, but I'm actually going to do some specific imports, some named imports. I know I'm going to need a `buildRequest`, a `buildResponse`, a `buildUser`, `buildBook`, and a `buildListItem`.

#### list-items-controller.exercise.js

```javascript
import {
  buildRes,
  buildReq,
  buildUser,
  buildBook,
  buildListItem
} from "utils/generate";
```

[00:43] With all of those builders ready to go, this `getListItem` also calls the `expandBookData`, which calls the `readById`, so we're going to need to import the database here so we can make assertions on how this `booksDB` is being interacted with, since we're going to mock it out.

```javascript
import * as booksDB from "../../db/books";
```

[00:59] Then of course, we do have this one thing that we're testing. Let's go ahead and import the `listItemsController` so that we can call the `getListItem` function on that.

[01:08] Now, because we want to mock out the books database, we need to use `jest.mock`. To do that, we're just going to pass this same path to `jest.mock`. Jest will automatically create a mock version of that module. All of the functions that that module exposes will be mock functions.

```javascript
jest.mock("../../db/books");
```

[01:23] It applies not only to this file where we're calling `jest.mock`, but anywhere else in our code base that is importing the books database during the lifetime of this test suite. Right up here in that `booksDB`, that's going to be the mock version of the `booksDB` as well. When we come down here to the `readById`, it's going to be calling the mock version of that function which exactly what we want.

[01:46] One other thing. When we're writing multiple tests in this file, it's a good idea to keep them isolated from each other. Just like in the example, we're going to have a `beforeEach` right here. That's simply going to call `jest.clearAllMocks`. That way, we make sure that the mock functions have all of their call history cleared out between the test to keep them isolated.

```javascript
beforeEach(() => {
  jest.clearAllMocks();
});
```

[02:06] Great. Right here, our `test`, we're going to need to create a `user` and a `book`. Let's do `user` = `buildUser`. Our `book` is going to be `buildBook`.

```javascript
test("getListItem returns the req.listItem", async () => {
  const user = buildUser();
  const book = buildBook();
});
```

We're also going to need a `listItem` that has the `user` as the `owner` and the `book` as the `book`. Let's make that.

[02:22] We're going to use the money bags code sample here. That's going to build the `listItem`, set the `owner` to the `user.id`, and the `book` to the `book.id`. It's really important also that we spell things correctly. We're going to fix that.

```javascript
const listItem = buildListItem({ ownerId: user.id, bookId: book.id });
```

[02:36] Now, we have all of our fake data. We need to make sure that when people call the `readById` method on our books database, that it returns the thing that we want it to return. The thing we want it to return is this `book`.

[02:47] We're going to use `mockResolvedValueOnce` so that when this function is called, it returns a promise which resolves to the `book`. Let's go ahead and say `booksDB.readById.mockResolvedValueOnce` that `book`. When it's called it returns a promise that resolves to this `book`.

```javascript
booksDB.readById.mockResolvedValueOnce(book);
```

[03:08] Now we can make our request object which is `buildReq` that will have our `user` and the `listItem`. Then we'll have our response object which is `buildRes`. That's a normal response object.

```javascript
const req = buildReq({ user, listItem });
const res = buildRes();
```

From here, we can `await` the `listItemsController.getListItem` with that request and response. Then we can make our assertions on how the database was interacted with as well as this response object.

```javascript
await listItemsController.getListItem(req, res);

expect(booksDB.readById).toHaveBeenCalledWith(book.id);
expect(booksDB.readById).toHaveBeenCalledTimes(1);
```

[03:32] Let's take a look at that really quick to remind ourselves here. We'll go up to `getListItem`. The way that this works is it calls in to `expandBookData` with the `req.listItem`. We are putting the `listItem` on request which is perfect.

#### list-items-controller.js

```javascript
async function getListItem(req, res) {
  res.json({ listItem: await expandBookData(req.listItem) });
}
```

[03:47] Then we jump into there and we're going to `await` a `readById` call so we can assert that `readById` was called with the `listItem.bookid`. That is returned. Then we return the `listItem` with all of its properties plus the `book` as a property on that object.

```javascript
async function expandBookData(listItem) {
  const book = await booksDB.readById(listItem.bookId);
  return { ...listItem, book };
}
```

[04:04] Ultimately, that's going to come back into this object that we're creating here, which has a `listItem` property pointing to what is returned from `expandBookData`. Then from there, we're going to call `res.json` with that object. Let's start out with the database call here.

[04:18] We're going to `expect` the `booksdb.readById` `toHaveBeenCalledWith` `book.id` . We'll `expect` that `toHaveBeenCalledTimes` once and only once.

#### list-items-controller.exercise

```javascript
expect(booksDB.readById).toHaveBeenCalledWith(book.id);
expect(booksDB.readById).toHaveBeenCalledTimes(1);
```

Then we'll `expect` `res.json` to have been called with a `listItem` that is all of the properties from our fake `listItem` plus the `book`. We'll, of course, `expect` `res.json` `toHaveBeenCalledTimes` once and only once.

```javascript
expect(res.json).toHaveBeenCalledWith({
  listItem: { ...listItem, book }
});
expect(res.json).toHaveBeenCalledTimes(1);
```

[04:50] With that, that covers all of our cases here. We'll save that. Open up our test. Yeah, it's passing.

![Passing Test](https://res.cloudinary.com/dg3gyk0gu/image/upload/v1575572533/transcript-images/13_scikit-learn-write-a-unit-test-for-a-controller-by-mocking-the-database-passing.jpg)

Let's make sure that we're testing what we think we're testing by going into the `getListItem`. Instead of awaiting the expanded version, we'll return the `req.listItem`.

#### list-items-controller.js

```javascript
async function getListItem(req, res) {
  res.json({ listItem: req.listItem });
}
```

![Failing](https://res.cloudinary.com/dg3gyk0gu/image/upload/v1575572533/transcript-images/13_scikit-learn-write-a-unit-test-for-a-controller-by-mocking-the-database-failed.jpg)

[05:09] Perfect, we are getting a failure because the book database was not called. We are testing the code that we think we're testing. We'll save that. It's all working. We can review now. Let's take a look at what we did here.

[05:23] First, we imported a bunch of test object factories here for our request, response, the `user` and the `book`, and the `listItem`. We imported the books, but because we're mocking this, that book's database is going to be a mocked version of that. We don't actually interact with the database.

[05:38] We can be more explicit about what that should return. We're also importing the `listItemController` so that we can actually run the code that we're testing.

```javascript
import {
  buildRes,
  buildReq,
  buildUser,
  buildBook,
  buildListItem
} from "utils/generate";
import * as booksDB from "../../db/books";
import * as listItemsController from "../list-items-controller";

jest.mock("../../db/books");
```

Here, we're clearing all the mocks between our tests so that our tests are isolated from each other.

```javascript
beforeEach(() => {
  jest.clearAllMocks();
});
```

[05:52] We create a `user`, a `book`, a `listItem` that is associated to that `user` and `book`. We make sure that the `book.readById` resolves to that `book`.

```javascript
test('getListItem returns the req.listItem', async () => {
  const user = buildUser()
  const book = buildBook()
  const listItem = buildListItem({ownerId: user.id, bookId: book.id})

  booksDB.readById.mockResolvedValueOnce(book)
```

We make a request and response object. We call `getListItem` with that request and response.

```javascript
const req = buildReq({ user, listItem });
const res = buildRes();

await listItemsController.getListItem(req, res);
```

[06:06] Of course, that request does need to have the `user` and the `listItem` attached to it. The `booksdB.readById` is called with that `book.id`, and it's only called one time, and `res.json` is called with a `listItem` that has all the properties from our `listItem`, plus a property for the `book`, and that's only called once.

```javascript
expect(booksDB.readById).toHaveBeenCalledWith(book.id);
expect(booksDB.readById).toHaveBeenCalledTimes(1);

expect(res.json).toHaveBeenCalledWith({
  listItem: { ...listItem, book }
});
expect(res.json).toHaveBeenCalledTimes(1);
```


Backends hold so much of our application's business logic that is often used to support multiple clients (web, mobile, and other native platforms). This logic is critical to get right and deploying a breaking change to this can be devastating to your company's goals (not to mention the bottom-line). Increasing your "deployment confidence" is crucial and automated testing is the best way to do that.

As Node.js continues to grow in usage around the world, learning how to test this mission-critical code in a way that increases developer velocity as well as confidence becomes increasingly important. In this workshop we use an Express.js example and focus on the patterns and practices that you need to learn so you can apply what you learn to test your code written in any Node.js web framework.

You'll learn:

Intro to Test Node.js Backends

Of all things you can test, the easiest thing you can test is a pure function because they require no setup or teardown. In this exercise, we’ll explore testing a pure function called isPasswordAllowed.

Test Pure Functions Overview

Let’s write the basic tests for our simple isPasswordAllowed function to ensure that both valid and invalid passwords receive the correct return value.

Write Unit Tests for a Simple Pure Function

One of the most crucial things you can do when writing tests is ensuring that the error message explains the problem as clearly as possible so it can be addressed quickly. Let’s improve our test by generating test titles so error messages are more descriptive.

Improve Error Messages by Generating Test Titles

Jest has a test-generation feature built-in called test.each which is great, but I don’t particularly like it’s API. Instead, we’re going to use an open source project called jest-in-case which gives us a really nice API for generated tests and improved error messages. Let’s try that library out for our isPasswordAllowed tests here.

Use jest-in-case to Reduce Duplication and Improve Test Titles

Even with jest-in-case there can be a little boilerplate and you can easily side-step that by creating a simple function that allows you to write test cases that are more suited for your use case. Let’s give that a try!

Create a Casify Function to Generate Cases for jest-in-case

There are various types of middleware and for many of them you write tests for them in the same way, so let’s get a look at one of these and try our hand at writing some tests for it.

Test Node Middleware Overview

We have an error middleware in our app for handling uncaught errors throughout our application. Let’s write our first test case for handling an UnauthorizedError which our authentication abstraction throws when someone attempts to access data they shouldn’t.

Write a Unit Test for Handling an UnauthorizedError

Our next test will be really similar to the first. This time we want to handle the case where a response has already been sent which you know if the res.headersSent property is set. So we’ll add that property to our fake response object and verify the middleware behaves correctly.

Write a Unit Test for Handling headersSent in an Error Middleware

Our final case is the fallback scenario where we don’t know exactly why things are failing. In this situation we’ll just give all the information that we can and hopefully the developers can figure out what that is. Let’s write a test case for that situation.

Write a Unit Test for Status 500 Error Middleware Fallback

We’ve got a little bit of duplication between these tests and in a more complex middleware we’ll have a lot of duplication. The duplication itself isn’t necessarily problematic. The problem comes in the form of readability of our tests. When there’s a great amount of duplication, it makes it harder to identify the parts of the test that distinguishes it from other tests. In this lesson we’ll apply the object factory pattern to reduce duplication and make it easier to maintain our tests.

Improve Test Maintainability using the Test Object Factory Pattern

We’re going to need the same utilities for our object factories in several places in our tests, so let’s use some pre-built utilities instead of the ones we wrote for this file.

Use a Test Object Factory utils/generate

Controllers are a collection of middleware that applies business logic specific to your domain. Typically these are tested like any other middleware, but often they require mocking the database for unit tests.

Test Node Controllers Overview

Let’s add a test for an edge case that responds with an error message. In this lesson we’ll talk about the value of using the toMatchInlineSnapshot assertion for error messages.

Simplify Assertions on Error Messages with toMatchInlineSnapshot

Not all controller middleware send responses. In this unit test, we’ll verify that a controller’s middleware interacts with the request, response, next function, and database correctly.

Unit Test Business Logic of a Controller’s Middleware

Sometimes people try to access data that’s not there and it would be great if our server doesn’t fall over when they do, so we have some code to handle that case. Let’s get that tested and use toMatchInlineSnapshot for asserting on the error message.

Test Controller 404 Edge Case where Resource is Not Found

If the user tries to access a resource they shouldn’t have access to, we need to make sure they can’t get that resource, and we’ll want a test to make sure that functionality doesn’t break because this is a data security concern. In this one we handle dynamic data in a snapshot by making a consistent ID for the user and list item.

Test Controller Unauthorized Case

We have another controller function we want to test that will retrieve all of the user’s list items. For this one we’ll need to mock out a few new APIs and build multiple books and list items. Then we’ll have to do a few things to ensure that the APIs were called correctly.

Test getListItems for Getting Multiple Mock Objects

We want to test the createListItem controller function so we can ensure that users can create new list items. In this one we need to mock out several database requests. We also see how great Jest error output is which helps us identify a few mistakes that we made really easily.

Test the Happy Path of a Creation Flow

Even though your edge cases don’t run as often as your happy path cases, they are important to test to make sure you handle those correctly. In this one we’ll verify that if a user attempts to create a new list item for a book even though they already have a list item for that book.

Testing an Error Case for createListItem

For this one, we’ll need to have an existing listItem and we’ll create some new notes for it. Then we’ll have the original list item and the updated list item and ensure that our API is being called with the right version of the list item.

Testing the Happy Path for updateListItem

This one’s a bit unique because it’s pretty simple. All we need to do here is verify that the remove method of our was called properly, but we don’t need to bother mocking out what it returns because our code doesn’t use that return value. We also want to verify that the res.json was called properly, so we’ll do that as well.

Testing Resource Deletion

Let’s start doing some server integration tests. We’ll get our server started and database going so we can hit the endpoints in the same way clients will be using our endpoints. Let’s explore how our app is started so we can start it in our test environment and I’ll show you around the codebase so you can navigate around while you test things out.

Test Authentication API Routes Overview

Let’s get our test ready to roll by getting our API server and database started and in a clean state. Because our tests and server both run in node, we can do this all using the utilities that Jest exposes for us like beforeAll and afterAll. Then we’ll get a test started and fire a request to the API to make sure we can communicate with the server.

Start a Node Server and Fire a Request to an HTTP API Endpoint

When you’re interacting with the API response of a server, some of the data you receive is information that you cannot assert on directly. In this lesson we’ll talk about how to use Jest’s asymmetric matchers to assert on the type of data your server is sending.

Make Assertions on HTTP API Responses for Registration

Let’s make another request in this same test to the login endpoint with the same post data as we used for registration. Then we can verify that the information we retrieved from the registration request is the same as the information we retrieved from the login request.

Test the Login Endpoint for a Node Server

Our server has an API for authenticated clients to request information for the currently logged in user. Let’s make an authenticated request using the user token we retrieved from the login request to get confidence that the token generated will get the data for the user.

Test the User’s Resource Endpoint

We’ve got a bit of duplication in our test for each request and it’d be nice to remove that, so we’ll create a pre-configured axios client to reduce that duplication.

Create a Pre-configured axios Client for the baseURL

If our request fails, the error message is really useless. The server sends us back a much more useful error message, but by default Jest wont display that error properly and we can’t identify the line of code that made the failing request. Let’s use a custom axios interceptor which will improve those error messages considerably by displaying the response that the server returned.

Improve Error Messages with an axios Interceptor

If you want to run your tests in parallel and each of your tests starts up the server on its own, then you could run into a problem where two servers try to bind to the same port. To avoid this, we can use the JEST_WORKER_ID environment variable so we can ensure that the port our server starts on is unique. Let’s try that out.

Ensure a Unique Server Port

Let’s test the case where we try to register two users of the same username. We’ll first register a user, and then we’ll attempt to register a second user with the same username and assert on the error message. We’ll use toMatchInlineSnapshot on the error that’s returned and Jest will serialize that like a champ.

Use Snapshots to Assert on Server Error Responses

Often in integration tests you’ll have situations where you are over testing. Sometimes that’s acceptable, but you can speed up your tests by getting your application into a testable state a little quicker. In this lesson we’ll skip hitting the API for our setup and instead interact directly with the database.

Interact Directly with the Database

Integration tests are typically best for common cases and you can cover other cases using lower level tests, but I thought it’d be interesting to show you how to cover a few other edge cases as well in this lesson.

Test all the Edge Cases

Things change a little bit when we want to hit an endpoint that requires the user to be authenticated. For this exercise you’ll need to use an authenticated test with a test user that’s already in the database. Then you can use that test user for each of the operations you do on the list item resource (Create, React, Update, Delete).

Test CRUD API Routes Overview

Let’s get a test user and authenticated axios client, and then we’ll need to generate a book and insert that into the database directly so we can create a list item for our test user for that book. Then we can verify that the response data is correct.

Write an Integration Test for a Resource Create Endpoint

Now that we’ve created a list item, let’s try to read that list item. This will give us confidence that the list item we created was actually saved to the database and can now be retrieved.

Write an Integration Test for a Resource Read Endpoint

For the update, we’ll need to create new notes for our list item and send those updates to the updates endpoint. Then we can verify that the response we get back is the same as the original list item except with the updated notes.

Integration Test a Resource Update Endpoint

For our delete endpoint, we don’t need to do too much beyond hitting the endpoint, but it could be problematic if we just hit the endpoint and verify the response. In this lesson we’ll find out why that is and how we can use our test to make sure that the item was actually deleted from the database.

Integration Test a Resource Delete Endpoint

Typically, it’s nicer to use toMatchInlineSnapshot for error messages, but sometimes the contents of the error message are generated. But I’ve got a little trick for solving this problem that you’ll probably find useful.

Write a Unit Test for a Controller by Mocking the Database

Transcript

Write a Unit Test for a Controller by Mocking the Database