=============Testing tools=============.. currentmodule:: django.testDjango provides a small set of tools that come in handy when writing tests... _test-client:The test client===============The test client is a Python class that acts as a dummy web browser, allowingyou to test your views and interact with your Django-powered applicationprogrammatically.Some of the things you can do with the test client are:* Simulate GET and POST requests on a URL and observe the response --everything from low-level HTTP (result headers and status codes) topage content.* See the chain of redirects (if any) and check the URL and status code ateach step.* Test that a given request is rendered by a given Django template, witha template context that contains certain values.Note that the test client is not intended to be a replacement for Selenium_ orother "in-browser" frameworks. Django's test client has a different focus. Inshort:* Use Django's test client to establish that the correct template is beingrendered and that the template is passed the correct context data.* Use :class:`~django.test.RequestFactory` to test view functions directly,bypassing the routing and middleware layers.* Use in-browser frameworks like Selenium_ to test *rendered* HTML and the*behavior* of web pages, namely JavaScript functionality. Django alsoprovides special support for those frameworks; see the section on:class:`~django.test.LiveServerTestCase` for more details.A comprehensive test suite should use a combination of all of these test types.Overview and a quick example----------------------------To use the test client, instantiate ``django.test.Client`` and retrieveweb pages::>>> from django.test import Client>>> c = Client()>>> response = c.post('/login/', {'username': 'john', 'password': 'smith'})>>> response.status_code200>>> response = c.get('/customer/details/')>>> response.contentb'<!DOCTYPE html...'As this example suggests, you can instantiate ``Client`` from within a sessionof the Python interactive interpreter.Note a few important things about how the test client works:* The test client does *not* require the web server to be running. In fact,it will run just fine with no web server running at all! That's becauseit avoids the overhead of HTTP and deals directly with the Djangoframework. This helps make the unit tests run quickly.* When retrieving pages, remember to specify the *path* of the URL, not thewhole domain. For example, this is correct::>>> c.get('/login/')This is incorrect::>>> c.get('https://www.example.com/login/')The test client is not capable of retrieving web pages that are notpowered by your Django project. If you need to retrieve other web pages,use a Python standard library module such as :mod:`urllib`.* To resolve URLs, the test client uses whatever URLconf is pointed-to byyour :setting:`ROOT_URLCONF` setting.* Although the above example would work in the Python interactiveinterpreter, some of the test client's functionality, notably thetemplate-related functionality, is only available *while tests arerunning*.The reason for this is that Django's test runner performs a bit of blackmagic in order to determine which template was loaded by a given view.This black magic (essentially a patching of Django's template system inmemory) only happens during test running.* By default, the test client will disable any CSRF checksperformed by your site.If, for some reason, you *want* the test client to perform CSRFchecks, you can create an instance of the test client thatenforces CSRF checks. To do this, pass in the``enforce_csrf_checks`` argument when you construct yourclient::>>> from django.test import Client>>> csrf_client = Client(enforce_csrf_checks=True)Making requests---------------Use the ``django.test.Client`` class to make requests... class:: Client(enforce_csrf_checks=False, raise_request_exception=True, json_encoder=DjangoJSONEncoder, **defaults)It requires no arguments at time of construction. However, you can usekeyword arguments to specify some default headers. For example, this willsend a ``User-Agent`` HTTP header in each request::>>> c = Client(HTTP_USER_AGENT='Mozilla/5.0')The values from the ``extra`` keyword arguments passed to:meth:`~django.test.Client.get()`,:meth:`~django.test.Client.post()`, etc. have precedence overthe defaults passed to the class constructor.The ``enforce_csrf_checks`` argument can be used to test CSRFprotection (see above).The ``raise_request_exception`` argument allows controlling whether or notexceptions raised during the request should also be raised in the test.Defaults to ``True``.The ``json_encoder`` argument allows setting a custom JSON encoder forthe JSON serialization that's described in :meth:`post`.Once you have a ``Client`` instance, you can call any of the followingmethods:.. method:: Client.get(path, data=None, follow=False, secure=False, **extra)Makes a GET request on the provided ``path`` and returns a ``Response``object, which is documented below.The key-value pairs in the ``data`` dictionary are used to create a GETdata payload. For example::>>> c = Client()>>> c.get('/customers/details/', {'name': 'fred', 'age': 7})...will result in the evaluation of a GET request equivalent to::/customers/details/?name=fred&age=7The ``extra`` keyword arguments parameter can be used to specifyheaders to be sent in the request. For example::>>> c = Client()>>> c.get('/customers/details/', {'name': 'fred', 'age': 7},... HTTP_ACCEPT='application/json')...will send the HTTP header ``HTTP_ACCEPT`` to the details view, whichis a good way to test code paths that use the:meth:`django.http.HttpRequest.accepts()` method... admonition:: CGI specificationThe headers sent via ``**extra`` should follow CGI_ specification.For example, emulating a different "Host" header as sent in theHTTP request from the browser to the server should be passedas ``HTTP_HOST``... _CGI: https://www.w3.org/CGI/If you already have the GET arguments in URL-encoded form, you canuse that encoding instead of using the data argument. For example,the previous GET request could also be posed as::>>> c = Client()>>> c.get('/customers/details/?name=fred&age=7')If you provide a URL with both an encoded GET data and a data argument,the data argument will take precedence.If you set ``follow`` to ``True`` the client will follow any redirectsand a ``redirect_chain`` attribute will be set in the response objectcontaining tuples of the intermediate urls and status codes.If you had a URL ``/redirect_me/`` that redirected to ``/next/``, thatredirected to ``/final/``, this is what you'd see::>>> response = c.get('/redirect_me/', follow=True)>>> response.redirect_chain[('http://testserver/next/', 302), ('http://testserver/final/', 302)]If you set ``secure`` to ``True`` the client will emulate an HTTPSrequest... method:: Client.post(path, data=None, content_type=MULTIPART_CONTENT, follow=False, secure=False, **extra)Makes a POST request on the provided ``path`` and returns a``Response`` object, which is documented below.The key-value pairs in the ``data`` dictionary are used to submit POSTdata. For example::>>> c = Client()>>> c.post('/login/', {'name': 'fred', 'passwd': 'secret'})...will result in the evaluation of a POST request to this URL::/login/...with this POST data::name=fred&passwd=secretIf you provide ``content_type`` as :mimetype:`application/json`, the``data`` is serialized using :func:`json.dumps` if it's a dict, list,or tuple. Serialization is performed with:class:`~django.core.serializers.json.DjangoJSONEncoder` by default,and can be overridden by providing a ``json_encoder`` argument to:class:`Client`. This serialization also happens for :meth:`put`,:meth:`patch`, and :meth:`delete` requests.If you provide any other ``content_type`` (e.g. :mimetype:`text/xml`for an XML payload), the contents of ``data`` are sent as-is in thePOST request, using ``content_type`` in the HTTP ``Content-Type``header.If you don't provide a value for ``content_type``, the values in``data`` will be transmitted with a content type of:mimetype:`multipart/form-data`. In this case, the key-value pairs in``data`` will be encoded as a multipart message and used to create thePOST data payload.To submit multiple values for a given key -- for example, to specifythe selections for a ``<select multiple>`` -- provide the values as alist or tuple for the required key. For example, this value of ``data``would submit three selected values for the field named ``choices``::{'choices': ('a', 'b', 'd')}Submitting files is a special case. To POST a file, you need onlyprovide the file field name as a key, and a file handle to the file youwish to upload as a value. For example, if your form has fields``name`` and ``attachment``, the latter a:class:`~django.forms.FileField`::>>> c = Client()>>> with open('wishlist.doc', 'rb') as fp:... c.post('/customers/wishes/', {'name': 'fred', 'attachment': fp})You may also provide any file-like object (e.g., :class:`~io.StringIO` or:class:`~io.BytesIO`) as a file handle. If you're uploading to an:class:`~django.db.models.ImageField`, the object needs a ``name``attribute that passes the:data:`~django.core.validators.validate_image_file_extension` validator.For example::>>> from io import BytesIO>>> img = BytesIO(... b"GIF89a\x01\x00\x01\x00\x00\x00\x00!\xf9\x04\x01\x00\x00\x00"... b"\x00,\x00\x00\x00\x00\x01\x00\x01\x00\x00\x02\x01\x00\x00"... )>>> img.name = "myimage.gif"Note that if you wish to use the same file handle for multiple``post()`` calls then you will need to manually reset the filepointer between posts. The easiest way to do this is tomanually close the file after it has been provided to``post()``, as demonstrated above.You should also ensure that the file is opened in a way thatallows the data to be read. If your file contains binary datasuch as an image, this means you will need to open the file in``rb`` (read binary) mode.The ``extra`` argument acts the same as for :meth:`Client.get`.If the URL you request with a POST contains encoded parameters, theseparameters will be made available in the request.GET data. For example,if you were to make the request::>>> c.post('/login/?visitor=true', {'name': 'fred', 'passwd': 'secret'})... the view handling this request could interrogate request.POSTto retrieve the username and password, and could interrogate request.GETto determine if the user was a visitor.If you set ``follow`` to ``True`` the client will follow any redirectsand a ``redirect_chain`` attribute will be set in the response objectcontaining tuples of the intermediate urls and status codes.If you set ``secure`` to ``True`` the client will emulate an HTTPSrequest... method:: Client.head(path, data=None, follow=False, secure=False, **extra)Makes a HEAD request on the provided ``path`` and returns a``Response`` object. This method works just like :meth:`Client.get`,including the ``follow``, ``secure`` and ``extra`` arguments, exceptit does not return a message body... method:: Client.options(path, data='', content_type='application/octet-stream', follow=False, secure=False, **extra)Makes an OPTIONS request on the provided ``path`` and returns a``Response`` object. Useful for testing RESTful interfaces.When ``data`` is provided, it is used as the request body, anda ``Content-Type`` header is set to ``content_type``.The ``follow``, ``secure`` and ``extra`` arguments act the same as for:meth:`Client.get`... method:: Client.put(path, data='', content_type='application/octet-stream', follow=False, secure=False, **extra)Makes a PUT request on the provided ``path`` and returns a``Response`` object. Useful for testing RESTful interfaces.When ``data`` is provided, it is used as the request body, anda ``Content-Type`` header is set to ``content_type``.The ``follow``, ``secure`` and ``extra`` arguments act the same as for:meth:`Client.get`... method:: Client.patch(path, data='', content_type='application/octet-stream', follow=False, secure=False, **extra)Makes a PATCH request on the provided ``path`` and returns a``Response`` object. Useful for testing RESTful interfaces.The ``follow``, ``secure`` and ``extra`` arguments act the same as for:meth:`Client.get`... method:: Client.delete(path, data='', content_type='application/octet-stream', follow=False, secure=False, **extra)Makes a DELETE request on the provided ``path`` and returns a``Response`` object. Useful for testing RESTful interfaces.When ``data`` is provided, it is used as the request body, anda ``Content-Type`` header is set to ``content_type``.The ``follow``, ``secure`` and ``extra`` arguments act the same as for:meth:`Client.get`... method:: Client.trace(path, follow=False, secure=False, **extra)Makes a TRACE request on the provided ``path`` and returns a``Response`` object. Useful for simulating diagnostic probes.Unlike the other request methods, ``data`` is not provided as a keywordparameter in order to comply with :rfc:`7231#section-4.3.8`, whichmandates that TRACE requests must not have a body.The ``follow``, ``secure``, and ``extra`` arguments act the same as for:meth:`Client.get`... method:: Client.login(**credentials)If your site uses Django's :doc:`authentication system</topics/auth/index>`and you deal with logging in users, you can use the test client's``login()`` method to simulate the effect of a user logging into thesite.After you call this method, the test client will have all the cookiesand session data required to pass any login-based tests that may formpart of a view.The format of the ``credentials`` argument depends on which:ref:`authentication backend <authentication-backends>` you're using(which is configured by your :setting:`AUTHENTICATION_BACKENDS`setting). If you're using the standard authentication backend providedby Django (``ModelBackend``), ``credentials`` should be the user'susername and password, provided as keyword arguments::>>> c = Client()>>> c.login(username='fred', password='secret')# Now you can access a view that's only available to logged-in users.If you're using a different authentication backend, this method mayrequire different credentials. It requires whichever credentials arerequired by your backend's ``authenticate()`` method.``login()`` returns ``True`` if it the credentials were accepted andlogin was successful.Finally, you'll need to remember to create user accounts before you canuse this method. As we explained above, the test runner is executedusing a test database, which contains no users by default. As a result,user accounts that are valid on your production site will not workunder test conditions. You'll need to create users as part of the testsuite -- either manually (using the Django model API) or with a testfixture. Remember that if you want your test user to have a password,you can't set the user's password by setting the password attributedirectly -- you must use the:meth:`~django.contrib.auth.models.User.set_password()` function tostore a correctly hashed password. Alternatively, you can use the:meth:`~django.contrib.auth.models.UserManager.create_user` helpermethod to create a new user with a correctly hashed password... method:: Client.force_login(user, backend=None)If your site uses Django's :doc:`authenticationsystem</topics/auth/index>`, you can use the ``force_login()`` methodto simulate the effect of a user logging into the site. Use this methodinstead of :meth:`login` when a test requires a user be logged in andthe details of how a user logged in aren't important.Unlike ``login()``, this method skips the authentication andverification steps: inactive users (:attr:`is_active=False<django.contrib.auth.models.User.is_active>`) are permitted to loginand the user's credentials don't need to be provided.The user will have its ``backend`` attribute set to the value of the``backend`` argument (which should be a dotted Python path string), orto ``settings.AUTHENTICATION_BACKENDS[0]`` if a value isn't provided.The :func:`~django.contrib.auth.authenticate` function called by:meth:`login` normally annotates the user like this.This method is faster than ``login()`` since the expensivepassword hashing algorithms are bypassed. Also, you can speed up``login()`` by :ref:`using a weaker hasher while testing<speeding-up-tests-auth-hashers>`... method:: Client.logout()If your site uses Django's :doc:`authentication system</topics/auth/index>`,the ``logout()`` method can be used to simulate the effect of a userlogging out of your site.After you call this method, the test client will have all the cookiesand session data cleared to defaults. Subsequent requests will appearto come from an :class:`~django.contrib.auth.models.AnonymousUser`.Testing responses-----------------The ``get()`` and ``post()`` methods both return a ``Response`` object. This``Response`` object is *not* the same as the ``HttpResponse`` object returnedby Django views; the test response object has some additional data useful fortest code to verify.Specifically, a ``Response`` object has the following attributes:.. class:: Response().. attribute:: clientThe test client that was used to make the request that resulted in theresponse... attribute:: contentThe body of the response, as a bytestring. This is the final pagecontent as rendered by the view, or any error message... attribute:: contextThe template ``Context`` instance that was used to render the template thatproduced the response content.If the rendered page used multiple templates, then ``context`` will be alist of ``Context`` objects, in the order in which they were rendered.Regardless of the number of templates used during rendering, you canretrieve context values using the ``[]`` operator. For example, thecontext variable ``name`` could be retrieved using::>>> response = client.get('/foo/')>>> response.context['name']'Arthur'.. admonition:: Not using Django templates?This attribute is only populated when using the:class:`~django.template.backends.django.DjangoTemplates` backend.If you're using another template engine,:attr:`~django.template.response.SimpleTemplateResponse.context_data`may be a suitable alternative on responses with that attribute... attribute:: exc_infoA tuple of three values that provides information about the unhandledexception, if any, that occurred during the view.The values are (type, value, traceback), the same as returned byPython's :func:`sys.exc_info`. Their meanings are:- *type*: The type of the exception.- *value*: The exception instance.- *traceback*: A traceback object which encapsulates the call stack atthe point where the exception originally occurred.If no exception occurred, then ``exc_info`` will be ``None``... method:: json(**kwargs)The body of the response, parsed as JSON. Extra keyword arguments arepassed to :func:`json.loads`. For example::>>> response = client.get('/foo/')>>> response.json()['name']'Arthur'If the ``Content-Type`` header is not ``"application/json"``, then a:exc:`ValueError` will be raised when trying to parse the response... attribute:: requestThe request data that stimulated the response... attribute:: wsgi_requestThe ``WSGIRequest`` instance generated by the test handler thatgenerated the response... attribute:: status_codeThe HTTP status of the response, as an integer. For a full listof defined codes, see the `IANA status code registry`_... _IANA status code registry: https://www.iana.org/assignments/http-status-codes/http-status-codes.xhtml.. attribute:: templatesA list of ``Template`` instances used to render the final content, inthe order they were rendered. For each template in the list, use``template.name`` to get the template's file name, if the template wasloaded from a file. (The name is a string such as``'admin/index.html'``.).. admonition:: Not using Django templates?This attribute is only populated when using the:class:`~django.template.backends.django.DjangoTemplates` backend.If you're using another template engine,:attr:`~django.template.response.SimpleTemplateResponse.template_name`may be a suitable alternative if you only need the name of thetemplate used for rendering... attribute:: resolver_matchAn instance of :class:`~django.urls.ResolverMatch` for the response.You can use the :attr:`~django.urls.ResolverMatch.func` attribute, forexample, to verify the view that served the response::# my_view here is a function based view.self.assertEqual(response.resolver_match.func, my_view)# Class-based views need to compare the view_class, as the# functions generated by as_view() won't be equal.self.assertIs(response.resolver_match.func.view_class, MyView)If the given URL is not found, accessing this attribute will raise a:exc:`~django.urls.Resolver404` exception.As with a normal response, you can also access the headers through:attr:`.HttpResponse.headers`. For example, you could determine the contenttype of a response using ``response.headers['Content-Type']``.Exceptions----------If you point the test client at a view that raises an exception and``Client.raise_request_exception`` is ``True``, that exception will be visiblein the test case. You can then use a standard ``try ... except`` block or:meth:`~unittest.TestCase.assertRaises` to test for exceptions.The only exceptions that are not visible to the test client are:class:`~django.http.Http404`,:class:`~django.core.exceptions.PermissionDenied`, :exc:`SystemExit`, and:class:`~django.core.exceptions.SuspiciousOperation`. Django catches theseexceptions internally and converts them into the appropriate HTTP responsecodes. In these cases, you can check ``response.status_code`` in your test.If ``Client.raise_request_exception`` is ``False``, the test client will return a500 response as would be returned to a browser. The response has the attribute:attr:`~Response.exc_info` to provide information about the unhandledexception.Persistent state----------------The test client is stateful. If a response returns a cookie, then that cookiewill be stored in the test client and sent with all subsequent ``get()`` and``post()`` requests.Expiration policies for these cookies are not followed. If you want a cookieto expire, either delete it manually or create a new ``Client`` instance (whichwill effectively delete all cookies).A test client has attributes that store persistent state information. You canaccess these properties as part of a test condition... attribute:: Client.cookiesA Python :class:`~http.cookies.SimpleCookie` object, containing the currentvalues of all the client cookies. See the documentation of the:mod:`http.cookies` module for more... attribute:: Client.sessionA dictionary-like object containing session information. See the:doc:`session documentation</topics/http/sessions>` for full details.To modify the session and then save it, it must be stored in a variablefirst (because a new ``SessionStore`` is created every time this propertyis accessed)::def test_something(self):session = self.client.sessionsession['somekey'] = 'test'session.save()Setting the language--------------------When testing applications that support internationalization and localization,you might want to set the language for a test client request. The method fordoing so depends on whether or not the:class:`~django.middleware.locale.LocaleMiddleware` is enabled.If the middleware is enabled, the language can be set by creating a cookie witha name of :setting:`LANGUAGE_COOKIE_NAME` and a value of the language code::from django.conf import settingsdef test_language_using_cookie(self):self.client.cookies.load({settings.LANGUAGE_COOKIE_NAME: 'fr'})response = self.client.get('/')self.assertEqual(response.content, b"Bienvenue sur mon site.")or by including the ``Accept-Language`` HTTP header in the request::def test_language_using_header(self):response = self.client.get('/', HTTP_ACCEPT_LANGUAGE='fr')self.assertEqual(response.content, b"Bienvenue sur mon site.").. note::When using these methods, ensure to reset the active language at the end ofeach test::def tearDown(self):translation.activate(settings.LANGUAGE_CODE)More details are in :ref:`how-django-discovers-language-preference`.If the middleware isn't enabled, the active language may be set using:func:`.translation.override`::from django.utils import translationdef test_language_using_override(self):with translation.override('fr'):response = self.client.get('/')self.assertEqual(response.content, b"Bienvenue sur mon site.")More details are in :ref:`explicitly-setting-the-active-language`.Example-------The following is a unit test using the test client::import unittestfrom django.test import Clientclass SimpleTest(unittest.TestCase):def setUp(self):# Every test needs a client.self.client = Client()def test_details(self):# Issue a GET request.response = self.client.get('/customer/details/')# Check that the response is 200 OK.self.assertEqual(response.status_code, 200)# Check that the rendered context contains 5 customers.self.assertEqual(len(response.context['customers']), 5).. seealso:::class:`django.test.RequestFactory`.. _django-testcase-subclasses:Provided test case classes==========================Normal Python unit test classes extend a base class of:class:`unittest.TestCase`. Django provides a few extensions of this base class:.. _testcase_hierarchy_diagram:.. figure:: _images/django_unittest_classes_hierarchy.*:alt: Hierarchy of Django unit testing classes (TestCase subclasses):width: 508:height: 328Hierarchy of Django unit testing classesYou can convert a normal :class:`unittest.TestCase` to any of the subclasses:change the base class of your test from ``unittest.TestCase`` to the subclass.All of the standard Python unit test functionality will be available, and itwill be augmented with some useful additions as described in each sectionbelow.``SimpleTestCase``------------------.. class:: SimpleTestCase()A subclass of :class:`unittest.TestCase` that adds this functionality:* Some useful assertions like:* Checking that a callable :meth:`raises a certain exception<SimpleTestCase.assertRaisesMessage>`.* Checking that a callable :meth:`triggers a certain warning<SimpleTestCase.assertWarnsMessage>`.* Testing form field :meth:`rendering and error treatment<SimpleTestCase.assertFieldOutput>`.* Testing :meth:`HTML responses for the presence/lack of a given fragment<SimpleTestCase.assertContains>`.* Verifying that a template :meth:`has/hasn't been used to generate a givenresponse content <SimpleTestCase.assertTemplateUsed>`.* Verifying that two :meth:`URLs <SimpleTestCase.assertURLEqual>` are equal.* Verifying an HTTP :meth:`redirect <SimpleTestCase.assertRedirects>` isperformed by the app.* Robustly testing two :meth:`HTML fragments <SimpleTestCase.assertHTMLEqual>`for equality/inequality or :meth:`containment <SimpleTestCase.assertInHTML>`.* Robustly testing two :meth:`XML fragments <SimpleTestCase.assertXMLEqual>`for equality/inequality.* Robustly testing two :meth:`JSON fragments <SimpleTestCase.assertJSONEqual>`for equality.* The ability to run tests with :ref:`modified settings <overriding-settings>`.* Using the :attr:`~SimpleTestCase.client` :class:`~django.test.Client`.If your tests make any database queries, use subclasses:class:`~django.test.TransactionTestCase` or :class:`~django.test.TestCase`... attribute:: SimpleTestCase.databases:class:`~SimpleTestCase` disallows database queries by default. Thishelps to avoid executing write queries which will affect other testssince each ``SimpleTestCase`` test isn't run in a transaction. If youaren't concerned about this problem, you can disable this behavior bysetting the ``databases`` class attribute to ``'__all__'`` on your testclass... warning::``SimpleTestCase`` and its subclasses (e.g. ``TestCase``, ...) rely on``setUpClass()`` and ``tearDownClass()`` to perform some class-wideinitialization (e.g. overriding settings). If you need to override thosemethods, don't forget to call the ``super`` implementation::class MyTestCase(TestCase):@classmethoddef setUpClass(cls):super().setUpClass()...@classmethoddef tearDownClass(cls):...super().tearDownClass()Be sure to account for Python's behavior if an exception is raised during``setUpClass()``. If that happens, neither the tests in the class nor``tearDownClass()`` are run. In the case of :class:`django.test.TestCase`,this will leak the transaction created in ``super()`` which results invarious symptoms including a segmentation fault on some platforms (reportedon macOS). If you want to intentionally raise an exception such as:exc:`unittest.SkipTest` in ``setUpClass()``, be sure to do it beforecalling ``super()`` to avoid this.``TransactionTestCase``-----------------------.. class:: TransactionTestCase()``TransactionTestCase`` inherits from :class:`~django.test.SimpleTestCase` toadd some database-specific features:* Resetting the database to a known state at the beginning of each test toease testing and using the ORM.* Database :attr:`~TransactionTestCase.fixtures`.* Test :ref:`skipping based on database backend features <skipping-tests>`.* The remaining specialized :meth:`assert*<TransactionTestCase.assertQuerysetEqual>` methods.Django's :class:`TestCase` class is a more commonly used subclass of``TransactionTestCase`` that makes use of database transaction facilitiesto speed up the process of resetting the database to a known state at thebeginning of each test. A consequence of this, however, is that some databasebehaviors cannot be tested within a Django ``TestCase`` class. For instance,you cannot test that a block of code is executing within a transaction, as isrequired when using:meth:`~django.db.models.query.QuerySet.select_for_update()`. In those cases,you should use ``TransactionTestCase``.``TransactionTestCase`` and ``TestCase`` are identical except for the mannerin which the database is reset to a known state and the ability for test codeto test the effects of commit and rollback:* A ``TransactionTestCase`` resets the database after the test runs bytruncating all tables. A ``TransactionTestCase`` may call commit and rollbackand observe the effects of these calls on the database.* A ``TestCase``, on the other hand, does not truncate tables after a test.Instead, it encloses the test code in a database transaction that is rolledback at the end of the test. This guarantees that the rollback at the end ofthe test restores the database to its initial state... warning::``TestCase`` running on a database that does not support rollback (e.g. MySQLwith the MyISAM storage engine), and all instances of ``TransactionTestCase``,will roll back at the end of the test by deleting all data from the testdatabase.Apps :ref:`will not see their data reloaded <test-case-serialized-rollback>`;if you need this functionality (for example, third-party apps should enablethis) you can set ``serialized_rollback = True`` inside the``TestCase`` body.``TestCase``------------.. class:: TestCase()This is the most common class to use for writing tests in Django. It inheritsfrom :class:`TransactionTestCase` (and by extension :class:`SimpleTestCase`).If your Django application doesn't use a database, use :class:`SimpleTestCase`.The class:* Wraps the tests within two nested :func:`~django.db.transaction.atomic`blocks: one for the whole class and one for each test. Therefore, if you wantto test some specific database transaction behavior, use:class:`TransactionTestCase`.* Checks deferrable database constraints at the end of each test.It also provides an additional method:.. classmethod:: TestCase.setUpTestData()The class-level ``atomic`` block described above allows the creation ofinitial data at the class level, once for the whole ``TestCase``. Thistechnique allows for faster tests as compared to using ``setUp()``.For example::from django.test import TestCaseclass MyTests(TestCase):@classmethoddef setUpTestData(cls):# Set up data for the whole TestCasecls.foo = Foo.objects.create(bar="Test")...def test1(self):# Some test using self.foo...def test2(self):# Some other test using self.foo...Note that if the tests are run on a database with no transaction support(for instance, MySQL with the MyISAM engine), ``setUpTestData()`` will becalled before each test, negating the speed benefits.Objects assigned to class attributes in ``setUpTestData()`` must supportcreating deep copies with :py:func:`copy.deepcopy` in order to isolate themfrom alterations performed by each test methods... classmethod:: TestCase.captureOnCommitCallbacks(using=DEFAULT_DB_ALIAS, execute=False)Returns a context manager that captures :func:`transaction.on_commit()<django.db.transaction.on_commit>` callbacks for the given databaseconnection. It returns a list that contains, on exit of the context, thecaptured callback functions. From this list you can make assertions on thecallbacks or call them to invoke their side effects, emulating a commit.``using`` is the alias of the database connection to capture callbacks for.If ``execute`` is ``True``, all the callbacks will be called as the contextmanager exits, if no exception occurred. This emulates a commit after thewrapped block of code.For example::from django.core import mailfrom django.test import TestCaseclass ContactTests(TestCase):def test_post(self):with self.captureOnCommitCallbacks(execute=True) as callbacks:response = self.client.post('/contact/',{'message': 'I like your site'},)self.assertEqual(response.status_code, 200)self.assertEqual(len(callbacks), 1)self.assertEqual(len(mail.outbox), 1)self.assertEqual(mail.outbox[0].subject, 'Contact Form')self.assertEqual(mail.outbox[0].body, 'I like your site').. versionchanged:: 4.0In older versions, new callbacks added while executing:func:`.transaction.on_commit` callbacks were not captured... _live-test-server:``LiveServerTestCase``----------------------.. class:: LiveServerTestCase()``LiveServerTestCase`` does basically the same as:class:`~django.test.TransactionTestCase` with one extra feature: it launches alive Django server in the background on setup, and shuts it down on teardown.This allows the use of automated test clients other than the:ref:`Django dummy client <test-client>` such as, for example, the Selenium_client, to execute a series of functional tests inside a browser and simulate areal user's actions.The live server listens on ``localhost`` and binds to port 0 which uses a freeport assigned by the operating system. The server's URL can be accessed with``self.live_server_url`` during the tests.To demonstrate how to use ``LiveServerTestCase``, let's write a Selenium test.First of all, you need to install the `selenium package`_ into your Pythonpath:.. console::$ python -m pip install seleniumThen, add a ``LiveServerTestCase``-based test to your app's tests module(for example: ``myapp/tests.py``). For this example, we'll assume you're usingthe :mod:`~django.contrib.staticfiles` app and want to have static files servedduring the execution of your tests similar to what we get at development timewith ``DEBUG=True``, i.e. without having to collect them using:djadmin:`collectstatic`. We'll usethe :class:`~django.contrib.staticfiles.testing.StaticLiveServerTestCase`subclass which provides that functionality. Replace it with``django.test.LiveServerTestCase`` if you don't need that.The code for this test may look as follows::from django.contrib.staticfiles.testing import StaticLiveServerTestCasefrom selenium.webdriver.common.by import Byfrom selenium.webdriver.firefox.webdriver import WebDriverclass MySeleniumTests(StaticLiveServerTestCase):fixtures = ['user-data.json']@classmethoddef setUpClass(cls):super().setUpClass()cls.selenium = WebDriver()cls.selenium.implicitly_wait(10)@classmethoddef tearDownClass(cls):cls.selenium.quit()super().tearDownClass()def test_login(self):self.selenium.get('%s%s' % (self.live_server_url, '/login/'))username_input = self.selenium.find_element(By.NAME, "username")username_input.send_keys('myuser')password_input = self.selenium.find_element(By.NAME, "password")password_input.send_keys('secret')self.selenium.find_element(By.XPATH, '//input[@value="Log in"]').click()Finally, you may run the test as follows:.. console::$ ./manage.py test myapp.tests.MySeleniumTests.test_loginThis example will automatically open Firefox then go to the login page, enterthe credentials and press the "Log in" button. Selenium offers other drivers incase you do not have Firefox installed or wish to use another browser. Theexample above is just a tiny fraction of what the Selenium client can do; checkout the `full reference`_ for more details... _Selenium: https://www.selenium.dev/.. _selenium package: https://pypi.org/project/selenium/.. _full reference: https://selenium-python.readthedocs.io/api.html.. _Firefox: https://www.mozilla.com/firefox/.. note::When using an in-memory SQLite database to run the tests, the same databaseconnection will be shared by two threads in parallel: the thread in whichthe live server is run and the thread in which the test case is run. It'simportant to prevent simultaneous database queries via this sharedconnection by the two threads, as that may sometimes randomly cause thetests to fail. So you need to ensure that the two threads don't access thedatabase at the same time. In particular, this means that in some cases(for example, just after clicking a link or submitting a form), you mightneed to check that a response is received by Selenium and that the nextpage is loaded before proceeding with further test execution.Do this, for example, by making Selenium wait until the ``<body>`` HTML tagis found in the response (requires Selenium > 2.13)::def test_login(self):from selenium.webdriver.support.wait import WebDriverWaittimeout = 2...self.selenium.find_element(By.XPATH, '//input[@value="Log in"]').click()# Wait until the response is receivedWebDriverWait(self.selenium, timeout).until(lambda driver: driver.find_element(By.TAG_NAME, 'body'))The tricky thing here is that there's really no such thing as a "page load,"especially in modern web apps that generate HTML dynamically after theserver generates the initial document. So, checking for the presence of``<body>`` in the response might not necessarily be appropriate for all usecases. Please refer to the `Selenium FAQ`_ and `Selenium documentation`_for more information... _Selenium FAQ: https://web.archive.org/web/20160129132110/http://code.google.com/p/selenium/wiki/FrequentlyAskedQuestions#Q:_WebDriver_fails_to_find_elements_/_Does_not_block_on_page_loa.. _Selenium documentation: https://www.selenium.dev/documentation/webdriver/waits/#explicit-waitTest cases features===================Default test client-------------------.. attribute:: SimpleTestCase.clientEvery test case in a ``django.test.*TestCase`` instance has access to aninstance of a Django test client. This client can be accessed as``self.client``. This client is recreated for each test, so you don't have toworry about state (such as cookies) carrying over from one test to another.This means, instead of instantiating a ``Client`` in each test::import unittestfrom django.test import Clientclass SimpleTest(unittest.TestCase):def test_details(self):client = Client()response = client.get('/customer/details/')self.assertEqual(response.status_code, 200)def test_index(self):client = Client()response = client.get('/customer/index/')self.assertEqual(response.status_code, 200)...you can refer to ``self.client``, like so::from django.test import TestCaseclass SimpleTest(TestCase):def test_details(self):response = self.client.get('/customer/details/')self.assertEqual(response.status_code, 200)def test_index(self):response = self.client.get('/customer/index/')self.assertEqual(response.status_code, 200)Customizing the test client---------------------------.. attribute:: SimpleTestCase.client_classIf you want to use a different ``Client`` class (for example, a subclasswith customized behavior), use the :attr:`~SimpleTestCase.client_class` classattribute::from django.test import Client, TestCaseclass MyTestClient(Client):# Specialized methods for your environment...class MyTest(TestCase):client_class = MyTestClientdef test_my_stuff(self):# Here self.client is an instance of MyTestClient...call_some_test_code().. _topics-testing-fixtures:Fixture loading---------------.. attribute:: TransactionTestCase.fixturesA test case for a database-backed website isn't much use if there isn't anydata in the database. Tests are more readable and it's more maintainable tocreate objects using the ORM, for example in :meth:`TestCase.setUpTestData`,however, you can also use fixtures.A fixture is a collection of data that Django knows how to import into adatabase. For example, if your site has user accounts, you might set up afixture of fake user accounts in order to populate your database during tests.The most straightforward way of creating a fixture is to use the:djadmin:`manage.py dumpdata <dumpdata>` command. This assumes youalready have some data in your database. See the :djadmin:`dumpdatadocumentation<dumpdata>` for more details.Once you've created a fixture and placed it in a ``fixtures`` directory in oneof your :setting:`INSTALLED_APPS`, you can use it in your unit tests byspecifying a ``fixtures`` class attribute on your :class:`django.test.TestCase`subclass::from django.test import TestCasefrom myapp.models import Animalclass AnimalTestCase(TestCase):fixtures = ['mammals.json', 'birds']def setUp(self):# Test definitions as before.call_setup_methods()def test_fluffy_animals(self):# A test that uses the fixtures.call_some_test_code()Here's specifically what will happen:* At the start of each test, before ``setUp()`` is run, Django will flush thedatabase, returning the database to the state it was in directly after:djadmin:`migrate` was called.* Then, all the named fixtures are installed. In this example, Django willinstall any JSON fixture named ``mammals``, followed by any fixture named``birds``. See the :djadmin:`loaddata` documentation for moredetails on defining and installing fixtures.For performance reasons, :class:`TestCase` loads fixtures once for the entiretest class, before :meth:`~TestCase.setUpTestData`, instead of before eachtest, and it uses transactions to clean the database before each test. In any case,you can be certain that the outcome of a test will not be affected by anothertest or by the order of test execution.By default, fixtures are only loaded into the ``default`` database. If you areusing multiple databases and set :attr:`TransactionTestCase.databases`,fixtures will be loaded into all specified databases.URLconf configuration---------------------If your application provides views, you may want to include tests that use thetest client to exercise those views. However, an end user is free to deploy theviews in your application at any URL of their choosing. This means that yourtests can't rely upon the fact that your views will be available at aparticular URL. Decorate your test class or test method with``@override_settings(ROOT_URLCONF=...)`` for URLconf configuration... _testing-multi-db:Multi-database support----------------------.. attribute:: TransactionTestCase.databasesDjango sets up a test database corresponding to every database that isdefined in the :setting:`DATABASES` definition in your settings and referred toby at least one test through ``databases``.However, a big part of the time taken to run a Django ``TestCase`` is consumedby the call to ``flush`` that ensures that you have a clean database at thestart of each test run. If you have multiple databases, multiple flushes arerequired (one for each database), which can be a time consuming activity --especially if your tests don't need to test multi-database activity.As an optimization, Django only flushes the ``default`` database atthe start of each test run. If your setup contains multiple databases,and you have a test that requires every database to be clean, you canuse the ``databases`` attribute on the test suite to request extra databasesto be flushed.For example::class TestMyViews(TransactionTestCase):databases = {'default', 'other'}def test_index_page_view(self):call_some_test_code()This test case will flush the ``default`` and ``other`` test databases beforerunning ``test_index_page_view``. You can also use ``'__all__'`` to specifythat all of the test databases must be flushed.The ``databases`` flag also controls which databases the:attr:`TransactionTestCase.fixtures` are loaded into. By default, fixtures areonly loaded into the ``default`` database.Queries against databases not in ``databases`` will give assertion errors toprevent state leaking between tests... attribute:: TestCase.databasesBy default, only the ``default`` database will be wrapped in a transactionduring a ``TestCase``'s execution and attempts to query other databases willresult in assertion errors to prevent state leaking between tests.Use the ``databases`` class attribute on the test class to request transactionwrapping against non-``default`` databases.For example::class OtherDBTests(TestCase):databases = {'other'}def test_other_db_query(self):...This test will only allow queries against the ``other`` database. Just like for:attr:`SimpleTestCase.databases` and :attr:`TransactionTestCase.databases`, the``'__all__'`` constant can be used to specify that the test should allowqueries to all databases... _overriding-settings:Overriding settings-------------------.. warning::Use the functions below to temporarily alter the value of settings in tests.Don't manipulate ``django.conf.settings`` directly as Django won't restorethe original values after such manipulations... method:: SimpleTestCase.settings()For testing purposes it's often useful to change a setting temporarily andrevert to the original value after running the testing code. For this use caseDjango provides a standard Python context manager (see :pep:`343`) called:meth:`~django.test.SimpleTestCase.settings`, which can be used like this::from django.test import TestCaseclass LoginTestCase(TestCase):def test_login(self):# First check for the default behaviorresponse = self.client.get('/sekrit/')self.assertRedirects(response, '/accounts/login/?next=/sekrit/')# Then override the LOGIN_URL settingwith self.settings(LOGIN_URL='/other/login/'):response = self.client.get('/sekrit/')self.assertRedirects(response, '/other/login/?next=/sekrit/')This example will override the :setting:`LOGIN_URL` setting for the codein the ``with`` block and reset its value to the previous state afterward... method:: SimpleTestCase.modify_settings()It can prove unwieldy to redefine settings that contain a list of values. Inpractice, adding or removing values is often sufficient. Django provides the:meth:`~django.test.SimpleTestCase.modify_settings` context manager for easiersettings changes::from django.test import TestCaseclass MiddlewareTestCase(TestCase):def test_cache_middleware(self):with self.modify_settings(MIDDLEWARE={'append': 'django.middleware.cache.FetchFromCacheMiddleware','prepend': 'django.middleware.cache.UpdateCacheMiddleware','remove': ['django.contrib.sessions.middleware.SessionMiddleware','django.contrib.auth.middleware.AuthenticationMiddleware','django.contrib.messages.middleware.MessageMiddleware',],}):response = self.client.get('/')# ...For each action, you can supply either a list of values or a string. When thevalue already exists in the list, ``append`` and ``prepend`` have no effect;neither does ``remove`` when the value doesn't exist... function:: override_settings(**kwargs)In case you want to override a setting for a test method, Django provides the:func:`~django.test.override_settings` decorator (see :pep:`318`). It's usedlike this::from django.test import TestCase, override_settingsclass LoginTestCase(TestCase):@override_settings(LOGIN_URL='/other/login/')def test_login(self):response = self.client.get('/sekrit/')self.assertRedirects(response, '/other/login/?next=/sekrit/')The decorator can also be applied to :class:`~django.test.TestCase` classes::from django.test import TestCase, override_settings@override_settings(LOGIN_URL='/other/login/')class LoginTestCase(TestCase):def test_login(self):response = self.client.get('/sekrit/')self.assertRedirects(response, '/other/login/?next=/sekrit/').. function:: modify_settings(*args, **kwargs)Likewise, Django provides the :func:`~django.test.modify_settings`decorator::from django.test import TestCase, modify_settingsclass MiddlewareTestCase(TestCase):@modify_settings(MIDDLEWARE={'append': 'django.middleware.cache.FetchFromCacheMiddleware','prepend': 'django.middleware.cache.UpdateCacheMiddleware',})def test_cache_middleware(self):response = self.client.get('/')# ...The decorator can also be applied to test case classes::from django.test import TestCase, modify_settings@modify_settings(MIDDLEWARE={'append': 'django.middleware.cache.FetchFromCacheMiddleware','prepend': 'django.middleware.cache.UpdateCacheMiddleware',})class MiddlewareTestCase(TestCase):def test_cache_middleware(self):response = self.client.get('/')# ..... note::When given a class, these decorators modify the class directly and returnit; they don't create and return a modified copy of it. So if you try totweak the above examples to assign the return value to a different namethan ``LoginTestCase`` or ``MiddlewareTestCase``, you may be surprised tofind that the original test case classes are still equally affected by thedecorator. For a given class, :func:`~django.test.modify_settings` isalways applied after :func:`~django.test.override_settings`... warning::The settings file contains some settings that are only consulted duringinitialization of Django internals. If you change them with``override_settings``, the setting is changed if you access it via the``django.conf.settings`` module, however, Django's internals access itdifferently. Effectively, using :func:`~django.test.override_settings` or:func:`~django.test.modify_settings` with these settings is probably notgoing to do what you expect it to do.We do not recommend altering the :setting:`DATABASES` setting. Alteringthe :setting:`CACHES` setting is possible, but a bit tricky if you areusing internals that make using of caching, like:mod:`django.contrib.sessions`. For example, you will have to reinitializethe session backend in a test that uses cached sessions and overrides:setting:`CACHES`.Finally, avoid aliasing your settings as module-level constants as``override_settings()`` won't work on such values since they areonly evaluated the first time the module is imported.You can also simulate the absence of a setting by deleting it after settingshave been overridden, like this::@override_settings()def test_something(self):del settings.LOGIN_URL...When overriding settings, make sure to handle the cases in which your app'scode uses a cache or similar feature that retains state even if the setting ischanged. Django provides the :data:`django.test.signals.setting_changed`signal that lets you register callbacks to clean up and otherwise reset statewhen settings are changed.Django itself uses this signal to reset various data:================================ ========================Overridden settings Data reset================================ ========================USE_TZ, TIME_ZONE Databases timezoneTEMPLATES Template enginesSERIALIZATION_MODULES Serializers cacheLOCALE_PATHS, LANGUAGE_CODE Default translation and loaded translationsMEDIA_ROOT, DEFAULT_FILE_STORAGE Default file storage================================ ========================Isolating apps--------------.. function:: utils.isolate_apps(*app_labels, attr_name=None, kwarg_name=None)Registers the models defined within a wrapped context into their ownisolated :attr:`~django.apps.apps` registry. This functionality is usefulwhen creating model classes for tests, as the classes will be cleanlydeleted afterward, and there is no risk of name collisions.The app labels which the isolated registry should contain must be passed asindividual arguments. You can use ``isolate_apps()`` as a decorator or acontext manager. For example::from django.db import modelsfrom django.test import SimpleTestCasefrom django.test.utils import isolate_appsclass MyModelTests(SimpleTestCase):@isolate_apps("app_label")def test_model_definition(self):class TestModel(models.Model):pass...… or::with isolate_apps("app_label"):class TestModel(models.Model):pass...The decorator form can also be applied to classes.Two optional keyword arguments can be specified:* ``attr_name``: attribute assigned the isolated registry if used as aclass decorator.* ``kwarg_name``: keyword argument passing the isolated registry if used asa function decorator.The temporary ``Apps`` instance used to isolate model registration can beretrieved as an attribute when used as a class decorator by using the``attr_name`` parameter::@isolate_apps("app_label", attr_name="apps")class TestModelDefinition(SimpleTestCase):def test_model_definition(self):class TestModel(models.Model):passself.assertIs(self.apps.get_model("app_label", "TestModel"), TestModel)… or alternatively as an argument on the test method when used as a methoddecorator by using the ``kwarg_name`` parameter::class TestModelDefinition(SimpleTestCase):@isolate_apps("app_label", kwarg_name="apps")def test_model_definition(self, apps):class TestModel(models.Model):passself.assertIs(apps.get_model("app_label", "TestModel"), TestModel).. _emptying-test-outbox:Emptying the test outbox------------------------If you use any of Django's custom ``TestCase`` classes, the test runner willclear the contents of the test email outbox at the start of each test case.For more detail on email services during tests, see `Email services`_ below... _assertions:Assertions----------As Python's normal :class:`unittest.TestCase` class implements assertion methodssuch as :meth:`~unittest.TestCase.assertTrue` and:meth:`~unittest.TestCase.assertEqual`, Django's custom :class:`TestCase` classprovides a number of custom assertion methods that are useful for testing webapplications:The failure messages given by most of these assertion methods can be customizedwith the ``msg_prefix`` argument. This string will be prefixed to any failuremessage generated by the assertion. This allows you to provide additionaldetails that may help you to identify the location and cause of a failure inyour test suite... method:: SimpleTestCase.assertRaisesMessage(expected_exception, expected_message, callable, *args, **kwargs)SimpleTestCase.assertRaisesMessage(expected_exception, expected_message)Asserts that execution of ``callable`` raises ``expected_exception`` andthat ``expected_message`` is found in the exception's message. Any otheroutcome is reported as a failure. It's a simpler version of:meth:`unittest.TestCase.assertRaisesRegex` with the difference that``expected_message`` isn't treated as a regular expression.If only the ``expected_exception`` and ``expected_message`` parameters aregiven, returns a context manager so that the code being tested can bewritten inline rather than as a function::with self.assertRaisesMessage(ValueError, 'invalid literal for int()'):int('a').. method:: SimpleTestCase.assertWarnsMessage(expected_warning, expected_message, callable, *args, **kwargs)SimpleTestCase.assertWarnsMessage(expected_warning, expected_message)Analogous to :meth:`SimpleTestCase.assertRaisesMessage` but for:meth:`~unittest.TestCase.assertWarnsRegex` instead of:meth:`~unittest.TestCase.assertRaisesRegex`... method:: SimpleTestCase.assertFieldOutput(fieldclass, valid, invalid, field_args=None, field_kwargs=None, empty_value='')Asserts that a form field behaves correctly with various inputs.:param fieldclass: the class of the field to be tested.:param valid: a dictionary mapping valid inputs to their expected cleanedvalues.:param invalid: a dictionary mapping invalid inputs to one or more raisederror messages.:param field_args: the args passed to instantiate the field.:param field_kwargs: the kwargs passed to instantiate the field.:param empty_value: the expected clean output for inputs in ``empty_values``.For example, the following code tests that an ``EmailField`` accepts``[email protected]`` as a valid email address, but rejects ``aaa`` with a reasonableerror message::self.assertFieldOutput(EmailField, {'[email protected]': '[email protected]'}, {'aaa': ['Enter a valid email address.']}).. method:: SimpleTestCase.assertFormError(form, field, errors, msg_prefix='')Asserts that a field on a form raises the provided list of errors.``form`` is a ``Form`` instance. The form must be:ref:`bound <ref-forms-api-bound-unbound>` but not necessarilyvalidated (``assertFormError()`` will automatically call ``full_clean()``on the form).``field`` is the name of the field on the form to check. To check the form's:meth:`non-field errors <django.forms.Form.non_field_errors>`, use``field=None``.``errors`` is a list of all the error strings that the field is expected tohave. You can also pass a single error string if you only expect one errorwhich means that ``errors='error message'`` is the same as``errors=['error message']``... versionchanged:: 4.1In older versions, using an empty error list with ``assertFormError()``would always pass, regardless of whether the field had any errors ornot. Starting from Django 4.1, using ``errors=[]`` will only pass ifthe field actually has no errors.Django 4.1 also changed the behavior of ``assertFormError()`` when afield has multiple errors. In older versions, if a field had multipleerrors and you checked for only some of them, the test would pass.Starting from Django 4.1, the error list must be an exact match to thefield's actual errors... deprecated:: 4.1Support for passing a response object and a form name to``assertFormError()`` is deprecated and will be removed in Django 5.0.Use the form instance directly instead... method:: SimpleTestCase.assertFormsetError(formset, form_index, field, errors, msg_prefix='')Asserts that the ``formset`` raises the provided list of errors whenrendered.``formset`` is a ``Formset`` instance. The formset must be bound but notnecessarily validated (``assertFormsetError()`` will automatically call the``full_clean()`` on the formset).``form_index`` is the number of the form within the ``Formset`` (startingfrom 0). Use ``form_index=None`` to check the formset's non-form errors,i.e. the errors you get when calling ``formset.non_form_errors()``. In thatcase you must also use ``field=None``.``field`` and ``errors`` have the same meaning as the parameters to``assertFormError()``... deprecated:: 4.1Support for passing a response object and a formset name to``assertFormsetError()`` is deprecated and will be removed in Django5.0. Use the formset instance directly instead... method:: SimpleTestCase.assertContains(response, text, count=None, status_code=200, msg_prefix='', html=False)Asserts that a :class:`response <django.http.HttpResponse>` produced thegiven :attr:`~django.http.HttpResponse.status_code` and that ``text``appears in its :attr:`~django.http.HttpResponse.content`. If ``count``is provided, ``text`` must occur exactly ``count`` times in the response.Set ``html`` to ``True`` to handle ``text`` as HTML. The comparison withthe response content will be based on HTML semantics instead ofcharacter-by-character equality. Whitespace is ignored in most cases,attribute ordering is not significant. See:meth:`~SimpleTestCase.assertHTMLEqual` for more details... method:: SimpleTestCase.assertNotContains(response, text, status_code=200, msg_prefix='', html=False)Asserts that a :class:`response <django.http.HttpResponse>` produced thegiven :attr:`~django.http.HttpResponse.status_code` and that ``text`` does*not* appear in its :attr:`~django.http.HttpResponse.content`.Set ``html`` to ``True`` to handle ``text`` as HTML. The comparison withthe response content will be based on HTML semantics instead ofcharacter-by-character equality. Whitespace is ignored in most cases,attribute ordering is not significant. See:meth:`~SimpleTestCase.assertHTMLEqual` for more details... method:: SimpleTestCase.assertTemplateUsed(response, template_name, msg_prefix='', count=None)Asserts that the template with the given name was used in rendering theresponse.``response`` must be a response instance returned by the:class:`test client <django.test.Response>`.``template_name`` should be a string such as ``'admin/index.html'``.The ``count`` argument is an integer indicating the number of times thetemplate should be rendered. Default is ``None``, meaning that the templateshould be rendered one or more times.You can use this as a context manager, like this::with self.assertTemplateUsed('index.html'):render_to_string('index.html')with self.assertTemplateUsed(template_name='index.html'):render_to_string('index.html').. method:: SimpleTestCase.assertTemplateNotUsed(response, template_name, msg_prefix='')Asserts that the template with the given name was *not* used in renderingthe response.You can use this as a context manager in the same way as:meth:`~SimpleTestCase.assertTemplateUsed`... method:: SimpleTestCase.assertURLEqual(url1, url2, msg_prefix='')Asserts that two URLs are the same, ignoring the order of query stringparameters except for parameters with the same name. For example,``/path/?x=1&y=2`` is equal to ``/path/?y=2&x=1``, but``/path/?a=1&a=2`` isn't equal to ``/path/?a=2&a=1``... method:: SimpleTestCase.assertRedirects(response, expected_url, status_code=302, target_status_code=200, msg_prefix='', fetch_redirect_response=True)Asserts that the :class:`response <django.http.HttpResponse>` returned a:attr:`~django.http.HttpResponse.status_code` redirect status, redirectedto ``expected_url`` (including any ``GET`` data), and that the final pagewas received with ``target_status_code``.If your request used the ``follow`` argument, the ``expected_url`` and``target_status_code`` will be the url and status code for the finalpoint of the redirect chain.If ``fetch_redirect_response`` is ``False``, the final page won't beloaded. Since the test client can't fetch external URLs, this isparticularly useful if ``expected_url`` isn't part of your Django app.Scheme is handled correctly when making comparisons between two URLs. Ifthere isn't any scheme specified in the location where we are redirected to,the original request's scheme is used. If present, the scheme in``expected_url`` is the one used to make the comparisons to... method:: SimpleTestCase.assertHTMLEqual(html1, html2, msg=None)Asserts that the strings ``html1`` and ``html2`` are equal. The comparisonis based on HTML semantics. The comparison takes following things intoaccount:* Whitespace before and after HTML tags is ignored.* All types of whitespace are considered equivalent.* All open tags are closed implicitly, e.g. when a surrounding tag isclosed or the HTML document ends.* Empty tags are equivalent to their self-closing version.* The ordering of attributes of an HTML element is not significant.* Boolean attributes (like ``checked``) without an argument are equal toattributes that equal in name and value (see the examples).* Text, character references, and entity references that refer to the samecharacter are equivalent.The following examples are valid tests and don't raise any``AssertionError``::self.assertHTMLEqual('<p>Hello <b>'world'!</p>','''<p>Hello <b>'world'! </b></p>''')self.assertHTMLEqual('<input type="checkbox" checked="checked" id="id_accept_terms" />','<input id="id_accept_terms" type="checkbox" checked>')``html1`` and ``html2`` must contain HTML. An ``AssertionError`` will beraised if one of them cannot be parsed.Output in case of error can be customized with the ``msg`` argument... versionchanged:: 4.0In older versions, any attribute (not only boolean attributes) withouta value was considered equal to an attribute with the same name andvalue... method:: SimpleTestCase.assertHTMLNotEqual(html1, html2, msg=None)Asserts that the strings ``html1`` and ``html2`` are *not* equal. Thecomparison is based on HTML semantics. See:meth:`~SimpleTestCase.assertHTMLEqual` for details.``html1`` and ``html2`` must contain HTML. An ``AssertionError`` will beraised if one of them cannot be parsed.Output in case of error can be customized with the ``msg`` argument... method:: SimpleTestCase.assertXMLEqual(xml1, xml2, msg=None)Asserts that the strings ``xml1`` and ``xml2`` are equal. Thecomparison is based on XML semantics. Similarly to:meth:`~SimpleTestCase.assertHTMLEqual`, the comparison ismade on parsed content, hence only semantic differences are considered, notsyntax differences. When invalid XML is passed in any parameter, an``AssertionError`` is always raised, even if both strings are identical.XML declaration, document type, processing instructions, and comments areignored. Only the root element and its children are compared.Output in case of error can be customized with the ``msg`` argument... method:: SimpleTestCase.assertXMLNotEqual(xml1, xml2, msg=None)Asserts that the strings ``xml1`` and ``xml2`` are *not* equal. Thecomparison is based on XML semantics. See:meth:`~SimpleTestCase.assertXMLEqual` for details.Output in case of error can be customized with the ``msg`` argument... method:: SimpleTestCase.assertInHTML(needle, haystack, count=None, msg_prefix='')Asserts that the HTML fragment ``needle`` is contained in the ``haystack``once.If the ``count`` integer argument is specified, then additionally the numberof ``needle`` occurrences will be strictly verified.Whitespace in most cases is ignored, and attribute ordering is notsignificant. See :meth:`~SimpleTestCase.assertHTMLEqual` for more details... method:: SimpleTestCase.assertJSONEqual(raw, expected_data, msg=None)Asserts that the JSON fragments ``raw`` and ``expected_data`` are equal.Usual JSON non-significant whitespace rules apply as the heavyweight isdelegated to the :mod:`json` library.Output in case of error can be customized with the ``msg`` argument... method:: SimpleTestCase.assertJSONNotEqual(raw, expected_data, msg=None)Asserts that the JSON fragments ``raw`` and ``expected_data`` are *not* equal.See :meth:`~SimpleTestCase.assertJSONEqual` for further details.Output in case of error can be customized with the ``msg`` argument... method:: TransactionTestCase.assertQuerysetEqual(qs, values, transform=None, ordered=True, msg=None)Asserts that a queryset ``qs`` matches a particular iterable of values``values``.If ``transform`` is provided, ``values`` is compared to a list produced byapplying ``transform`` to each member of ``qs``.By default, the comparison is also ordering dependent. If ``qs`` doesn'tprovide an implicit ordering, you can set the ``ordered`` parameter to``False``, which turns the comparison into a ``collections.Counter`` comparison.If the order is undefined (if the given ``qs`` isn't ordered and thecomparison is against more than one ordered value), a ``ValueError`` israised.Output in case of error can be customized with the ``msg`` argument... method:: TransactionTestCase.assertNumQueries(num, func, *args, **kwargs)Asserts that when ``func`` is called with ``*args`` and ``**kwargs`` that``num`` database queries are executed.If a ``"using"`` key is present in ``kwargs`` it is used as the databasealias for which to check the number of queries::self.assertNumQueries(7, using='non_default_db')If you wish to call a function with a ``using`` parameter you can do it bywrapping the call with a ``lambda`` to add an extra parameter::self.assertNumQueries(7, lambda: my_function(using=7))You can also use this as a context manager::with self.assertNumQueries(2):Person.objects.create(name="Aaron")Person.objects.create(name="Daniel").. _topics-tagging-tests:Tagging tests-------------You can tag your tests so you can easily run a particular subset. For example,you might label fast or slow tests::from django.test import tagclass SampleTestCase(TestCase):@tag('fast')def test_fast(self):...@tag('slow')def test_slow(self):...@tag('slow', 'core')def test_slow_but_core(self):...You can also tag a test case::@tag('slow', 'core')class SampleTestCase(TestCase):...Subclasses inherit tags from superclasses, and methods inherit tags from theirclass. Given::@tag('foo')class SampleTestCaseChild(SampleTestCase):@tag('bar')def test(self):...``SampleTestCaseChild.test`` will be labeled with ``'slow'``, ``'core'``,``'bar'``, and ``'foo'``.Then you can choose which tests to run. For example, to run only fast tests:.. console::$ ./manage.py test --tag=fastOr to run fast tests and the core one (even though it's slow):.. console::$ ./manage.py test --tag=fast --tag=coreYou can also exclude tests by tag. To run core tests if they are not slow:.. console::$ ./manage.py test --tag=core --exclude-tag=slow:option:`test --exclude-tag` has precedence over :option:`test --tag`, so if atest has two tags and you select one of them and exclude the other, the testwon't be run... _async-tests:Testing asynchronous code=========================If you merely want to test the output of your asynchronous views, the standardtest client will run them inside their own asynchronous loop without any extrawork needed on your part.However, if you want to write fully-asynchronous tests for a Django project,you will need to take several things into account.Firstly, your tests must be ``async def`` methods on the test class (in orderto give them an asynchronous context). Django will automatically detectany ``async def`` tests and wrap them so they run in their own event loop.If you are testing from an asynchronous function, you must also use theasynchronous test client. This is available as ``django.test.AsyncClient``,or as ``self.async_client`` on any test... class:: AsyncClient(enforce_csrf_checks=False, raise_request_exception=True, **defaults)``AsyncClient`` has the same methods and signatures as the synchronous (normal)test client, with two exceptions:* In the initialization, arbitrary keyword arguments in ``defaults`` are addeddirectly into the ASGI scope.* The ``follow`` parameter is not supported.* Headers passed as ``extra`` keyword arguments should not have the ``HTTP_``prefix required by the synchronous client (see :meth:`Client.get`). Forexample, here is how to set an HTTP ``Accept`` header::>>> c = AsyncClient()>>> c.get(... '/customers/details/',... {'name': 'fred', 'age': 7},... ACCEPT='application/json'... )Using ``AsyncClient`` any method that makes a request must be awaited::async def test_my_thing(self):response = await self.async_client.get('/some-url/')self.assertEqual(response.status_code, 200)The asynchronous client can also call synchronous views; it runs throughDjango's :doc:`asynchronous request path </topics/async>`, which supports both.Any view called through the ``AsyncClient`` will get an ``ASGIRequest`` objectfor its ``request`` rather than the ``WSGIRequest`` that the normal clientcreates... warning::If you are using test decorators, they must be async-compatible to ensurethey work correctly. Django's built-in decorators will behave correctly, butthird-party ones may appear to not execute (they will "wrap" the wrong partof the execution flow and not your test).If you need to use these decorators, then you should decorate your testmethods with :func:`~asgiref.sync.async_to_sync` *inside* of them instead::from asgiref.sync import async_to_syncfrom django.test import TestCaseclass MyTests(TestCase):@mock.patch(...)@async_to_syncasync def test_my_thing(self):..... _topics-testing-email:Email services==============If any of your Django views send email using :doc:`Django's emailfunctionality </topics/email>`, you probably don't want to send email each timeyou run a test using that view. For this reason, Django's test runnerautomatically redirects all Django-sent email to a dummy outbox. This lets youtest every aspect of sending email -- from the number of messages sent to thecontents of each message -- without actually sending the messages.The test runner accomplishes this by transparently replacing the normalemail backend with a testing backend.(Don't worry -- this has no effect on any other email senders outside ofDjango, such as your machine's mail server, if you're running one.).. currentmodule:: django.core.mail.. data:: django.core.mail.outboxDuring test running, each outgoing email is saved in``django.core.mail.outbox``. This is a list of all:class:`~django.core.mail.EmailMessage` instances that have been sent. The``outbox`` attribute is a special attribute that is created *only* when the``locmem`` email backend is used. It doesn't normally exist as part of the:mod:`django.core.mail` module and you can't import it directly. The code belowshows how to access this attribute correctly.Here's an example test that examines ``django.core.mail.outbox`` for lengthand contents::from django.core import mailfrom django.test import TestCaseclass EmailTest(TestCase):def test_send_email(self):# Send message.mail.send_mail('Subject here', 'Here is the message.','[email protected]', ['[email protected]'],fail_silently=False,)# Test that one message has been sent.self.assertEqual(len(mail.outbox), 1)# Verify that the subject of the first message is correct.self.assertEqual(mail.outbox[0].subject, 'Subject here')As noted :ref:`previously <emptying-test-outbox>`, the test outbox is emptiedat the start of every test in a Django ``*TestCase``. To empty the outboxmanually, assign the empty list to ``mail.outbox``::from django.core import mail# Empty the test outboxmail.outbox = [].. _topics-testing-management-commands:Management Commands===================Management commands can be tested with the:func:`~django.core.management.call_command` function. The output can beredirected into a ``StringIO`` instance::from io import StringIOfrom django.core.management import call_commandfrom django.test import TestCaseclass ClosepollTest(TestCase):def test_command_output(self):out = StringIO()call_command('closepoll', stdout=out)self.assertIn('Expected output', out.getvalue()).. _skipping-tests:Skipping tests==============.. currentmodule:: django.testThe unittest library provides the :func:`@skipIf <unittest.skipIf>` and:func:`@skipUnless <unittest.skipUnless>` decorators to allow you to skip testsif you know ahead of time that those tests are going to fail under certainconditions.For example, if your test requires a particular optional library in order tosucceed, you could decorate the test case with :func:`@skipIf<unittest.skipIf>`. Then, the test runner will report that the test wasn'texecuted and why, instead of failing the test or omitting the test altogether.To supplement these test skipping behaviors, Django provides twoadditional skip decorators. Instead of testing a generic boolean,these decorators check the capabilities of the database, and skip thetest if the database doesn't support a specific named feature.The decorators use a string identifier to describe database features.This string corresponds to attributes of the database connectionfeatures class. See:source:`django.db.backends.base.features.BaseDatabaseFeatures class<django/db/backends/base/features.py>` for a full list of database featuresthat can be used as a basis for skipping tests... function:: skipIfDBFeature(*feature_name_strings)Skip the decorated test or ``TestCase`` if all of the named database featuresare supported.For example, the following test will not be executed if the databasesupports transactions (e.g., it would *not* run under PostgreSQL, butit would under MySQL with MyISAM tables)::class MyTests(TestCase):@skipIfDBFeature('supports_transactions')def test_transaction_behavior(self):# ... conditional test codepass.. function:: skipUnlessDBFeature(*feature_name_strings)Skip the decorated test or ``TestCase`` if any of the named database featuresare *not* supported.For example, the following test will only be executed if the databasesupports transactions (e.g., it would run under PostgreSQL, but *not*under MySQL with MyISAM tables)::class MyTests(TestCase):@skipUnlessDBFeature('supports_transactions')def test_transaction_behavior(self):# ... conditional test codepass