Module src.StateDatabase.testcouchDB

Classes

class BenchmarkTest (methodName='runTest')

A class whose instances are single test cases.

By default, the test code itself should be placed in a method named 'runTest'.

If the fixture may be used for many test cases, create as many test methods as are needed. When instantiating such a TestCase subclass, specify in the constructor arguments the name of the test method that the instance is to execute.

Test authors should subclass TestCase for their own tests. Construction and deconstruction of the test's environment ('fixture') can be implemented by overriding the 'setUp' and 'tearDown' methods respectively.

If it is necessary to override the init method, the base class init method must always be called. It is important that subclasses should not change the signature of their init method, since instances of the classes are instantiated automatically by parts of the framework in order to be run.

When subclassing TestCase, you can set these attributes: * failureException: determines which exception will be raised when the instance's assertion methods fail; test methods raising this exception will be deemed to have 'failed' rather than 'errored'. * longMessage: determines whether long messages (including repr of objects used in assert methods) will be printed on failure in addition to any explicit message passed. * maxDiff: sets the maximum length of a diff in failure messages by assert methods using difflib. It is looked up as an instance attribute so can be configured by individual tests if required.

Create an instance of the class that will use the named test method when executed. Raises a ValueError if the instance does not have a method with the specified name.

Expand source code

class BenchmarkTest(DocumentTest):
    __database = "structures-test"
    __database_type = "structures"

    def setUp(self):
        super().set_database(self.__database_type, self.__database)
        super().setUp()


    def testBenchmarkWithStructures(self):
        N_DOCS = 100

        structure = dict(base_container)
        for i in range(N_DOCS):
            c_name = "struct{0}".format(i)
            structure["name"] = c_name
            self.couchdb.add_structure(structure)
            cont_limits = base_limits.copy()
            cont_limits["name"] = c_name
            self.couchdb.add_limit(cont_limits)

        for i in range(N_DOCS):
            c_name = "struct{0}".format(i)
            retrieved_structure = self.couchdb.get_structure(c_name)
            self.couchdb.get_limits(retrieved_structure)
            self.couchdb.delete_structure(retrieved_structure)

Ancestors

• DocumentTest
• unittest.case.TestCase

Methods

def testBenchmarkWithStructures(self)

Expand source code

def testBenchmarkWithStructures(self):
    N_DOCS = 100

    structure = dict(base_container)
    for i in range(N_DOCS):
        c_name = "struct{0}".format(i)
        structure["name"] = c_name
        self.couchdb.add_structure(structure)
        cont_limits = base_limits.copy()
        cont_limits["name"] = c_name
        self.couchdb.add_limit(cont_limits)

    for i in range(N_DOCS):
        c_name = "struct{0}".format(i)
        retrieved_structure = self.couchdb.get_structure(c_name)
        self.couchdb.get_limits(retrieved_structure)
        self.couchdb.delete_structure(retrieved_structure)

Inherited members

• DocumentTest:
  • setUp
  • tearDown

class DocumentTest (methodName='runTest')

A class whose instances are single test cases.

By default, the test code itself should be placed in a method named 'runTest'.

If the fixture may be used for many test cases, create as many test methods as are needed. When instantiating such a TestCase subclass, specify in the constructor arguments the name of the test method that the instance is to execute.

Test authors should subclass TestCase for their own tests. Construction and deconstruction of the test's environment ('fixture') can be implemented by overriding the 'setUp' and 'tearDown' methods respectively.

If it is necessary to override the init method, the base class init method must always be called. It is important that subclasses should not change the signature of their init method, since instances of the classes are instantiated automatically by parts of the framework in order to be run.

When subclassing TestCase, you can set these attributes: * failureException: determines which exception will be raised when the instance's assertion methods fail; test methods raising this exception will be deemed to have 'failed' rather than 'errored'. * longMessage: determines whether long messages (including repr of objects used in assert methods) will be printed on failure in addition to any explicit message passed. * maxDiff: sets the maximum length of a diff in failure messages by assert methods using difflib. It is looked up as an instance attribute so can be configured by individual tests if required.

Create an instance of the class that will use the named test method when executed. Raises a ValueError if the instance does not have a method with the specified name.

Expand source code

class DocumentTest(TestCase):
    __database = None
    __database_type = None
    __server_address = "localhost"
    __server_port = "5984"

    def set_database(self, database_type, database_test_name):
        self.__database_type = database_type
        self.__database = database_test_name

    def tearDown(self):
        self.couchdb.remove_database(self.__database)
        self.couchdb.close_connection()

    def setUp(self):
        self.couchdb = CouchDBServer(self.__server_address, self.__server_port)
        self.couchdb.set_database_name(self.__database_type, self.__database)
        if self.couchdb.database_exists(self.__database):
            self.couchdb.remove_database(self.__database)
        self.couchdb.create_database(self.__database)
        self.guardian = Guardian()

Ancestors

• unittest.case.TestCase

Subclasses

• BenchmarkTest
• EventsAndRequestsTest
• LimitsTest
• StructureTest

Methods

def setUp(self)

Hook method for setting up the test fixture before exercising it.

Expand source code

def setUp(self):
    self.couchdb = CouchDBServer(self.__server_address, self.__server_port)
    self.couchdb.set_database_name(self.__database_type, self.__database)
    if self.couchdb.database_exists(self.__database):
        self.couchdb.remove_database(self.__database)
    self.couchdb.create_database(self.__database)
    self.guardian = Guardian()

def set_database(self, database_type, database_test_name)

Expand source code

def set_database(self, database_type, database_test_name):
    self.__database_type = database_type
    self.__database = database_test_name

def tearDown(self)

Hook method for deconstructing the test fixture after testing it.

Expand source code

def tearDown(self):
    self.couchdb.remove_database(self.__database)
    self.couchdb.close_connection()

class EventsAndRequestsTest (methodName='runTest')

A class whose instances are single test cases.

By default, the test code itself should be placed in a method named 'runTest'.

If the fixture may be used for many test cases, create as many test methods as are needed. When instantiating such a TestCase subclass, specify in the constructor arguments the name of the test method that the instance is to execute.

Test authors should subclass TestCase for their own tests. Construction and deconstruction of the test's environment ('fixture') can be implemented by overriding the 'setUp' and 'tearDown' methods respectively.

If it is necessary to override the init method, the base class init method must always be called. It is important that subclasses should not change the signature of their init method, since instances of the classes are instantiated automatically by parts of the framework in order to be run.

When subclassing TestCase, you can set these attributes: * failureException: determines which exception will be raised when the instance's assertion methods fail; test methods raising this exception will be deemed to have 'failed' rather than 'errored'. * longMessage: determines whether long messages (including repr of objects used in assert methods) will be printed on failure in addition to any explicit message passed. * maxDiff: sets the maximum length of a diff in failure messages by assert methods using difflib. It is looked up as an instance attribute so can be configured by individual tests if required.

Create an instance of the class that will use the named test method when executed. Raises a ValueError if the instance does not have a method with the specified name.

Expand source code

class EventsAndRequestsTest(DocumentTest):
    __server_address = "localhost"
    __server_port = "5984"

    def tearDown(self):
        self.couchdb.remove_database("events-test")
        self.couchdb.remove_database("requests-test")
        self.couchdb.close_connection()

    def setUp(self):
        self.couchdb = CouchDBServer(self.__server_address, self.__server_port)
        self.couchdb.set_database_name("events", "events-test")
        self.couchdb.set_database_name("requests", "requests-test")

        if self.couchdb.database_exists("events-test"):
            self.couchdb.remove_database("events-test")
        self.couchdb.create_database("events-test")

        if self.couchdb.database_exists("requests-test"):
            self.couchdb.remove_database("requests-test")
        self.couchdb.create_database("requests-test")

        self.guardian = Guardian()

    def testEvents(self):
        structure = {
            "guard": True,
            "guard_policy": "serverless",
            "host": "c14-13",
            "host_rescaler_ip": "c14-13",
            "host_rescaler_port": "8000",
            "name": "node0",
            "resources": {
                "cpu": {
                    "current": 140,
                    "guard": True,
                    "max": 200,
                    "min": 50
                },
                "energy": {
                    "guard": False,
                    "max": 20,
                    "min": 0,
                    "usage": 2.34
                },
                "mem": {
                    "current": 3072,
                    "guard": True,
                    "max": 10240,
                    "min": 512
                }
            },
            "subtype": "container",
            "type": "structure"
        }
        limits = {"resources": {"cpu": {"upper": 120, "lower": 80, "boundary": 20},
                                "mem": {"upper": 2048, "lower": 1024, "boundary": 1024},
                                "energy": {"upper": 20, "lower": 10, "boundary": 5}}
                  }
        usages = {"structure.cpu.usage": 100, "structure.mem.usage": 1536, "structure.energy.usage": 15}

        event_rules = [cpu_exceeded_upper]
        rescaling_rules = [CpuRescaleUp]
        for rule in event_rules + rescaling_rules:
            rule["active"] = True

        resource, rescale_rule, amount = "cpu", CpuRescaleUp, 100

        self.guardian.guardable_resources = ["cpu"]

        usages["structure." + resource + ".usage"] = limits["resources"][resource]["lower"] + amount
        events = list()

        num_needed_events = rescale_rule["rule"]["and"][0][">="][1]

        for i in range(num_needed_events):
            events += self.guardian.match_usages_and_limits(structure["name"], event_rules, usages, limits["resources"],
                                                            structure["resources"])
        reduced_events = self.guardian.reduce_structure_events(events)

        generated_requests, events_to_remove = self.guardian.match_rules_and_events(structure, rescaling_rules,
                                                                                    reduced_events,
                                                                                    limits["resources"],
                                                                                    usages)

        TestCase.assertEqual(self, first=0, second=len(self.couchdb.get_events(structure)))
        self.couchdb.add_events(events)
        TestCase.assertEqual(self, first=num_needed_events, second=len(self.couchdb.get_events(structure)))
        self.couchdb.delete_events(self.couchdb.get_events(structure))
        self.couchdb.compact_database("events-test")
        TestCase.assertEqual(self, first=0, second=len(self.couchdb.get_events(structure)))

        TestCase.assertEqual(self, first=0, second=len(self.couchdb.get_requests(structure)))
        self.couchdb.add_requests(generated_requests)
        TestCase.assertEqual(self, first=1, second=len(self.couchdb.get_requests(structure)))
        self.couchdb.delete_request(self.couchdb.get_requests(structure)[0])
        TestCase.assertEqual(self, first=0, second=len(self.couchdb.get_requests(structure)))

Ancestors

• DocumentTest
• unittest.case.TestCase

Methods

def testEvents(self)

Expand source code

def testEvents(self):
    structure = {
        "guard": True,
        "guard_policy": "serverless",
        "host": "c14-13",
        "host_rescaler_ip": "c14-13",
        "host_rescaler_port": "8000",
        "name": "node0",
        "resources": {
            "cpu": {
                "current": 140,
                "guard": True,
                "max": 200,
                "min": 50
            },
            "energy": {
                "guard": False,
                "max": 20,
                "min": 0,
                "usage": 2.34
            },
            "mem": {
                "current": 3072,
                "guard": True,
                "max": 10240,
                "min": 512
            }
        },
        "subtype": "container",
        "type": "structure"
    }
    limits = {"resources": {"cpu": {"upper": 120, "lower": 80, "boundary": 20},
                            "mem": {"upper": 2048, "lower": 1024, "boundary": 1024},
                            "energy": {"upper": 20, "lower": 10, "boundary": 5}}
              }
    usages = {"structure.cpu.usage": 100, "structure.mem.usage": 1536, "structure.energy.usage": 15}

    event_rules = [cpu_exceeded_upper]
    rescaling_rules = [CpuRescaleUp]
    for rule in event_rules + rescaling_rules:
        rule["active"] = True

    resource, rescale_rule, amount = "cpu", CpuRescaleUp, 100

    self.guardian.guardable_resources = ["cpu"]

    usages["structure." + resource + ".usage"] = limits["resources"][resource]["lower"] + amount
    events = list()

    num_needed_events = rescale_rule["rule"]["and"][0][">="][1]

    for i in range(num_needed_events):
        events += self.guardian.match_usages_and_limits(structure["name"], event_rules, usages, limits["resources"],
                                                        structure["resources"])
    reduced_events = self.guardian.reduce_structure_events(events)

    generated_requests, events_to_remove = self.guardian.match_rules_and_events(structure, rescaling_rules,
                                                                                reduced_events,
                                                                                limits["resources"],
                                                                                usages)

    TestCase.assertEqual(self, first=0, second=len(self.couchdb.get_events(structure)))
    self.couchdb.add_events(events)
    TestCase.assertEqual(self, first=num_needed_events, second=len(self.couchdb.get_events(structure)))
    self.couchdb.delete_events(self.couchdb.get_events(structure))
    self.couchdb.compact_database("events-test")
    TestCase.assertEqual(self, first=0, second=len(self.couchdb.get_events(structure)))

    TestCase.assertEqual(self, first=0, second=len(self.couchdb.get_requests(structure)))
    self.couchdb.add_requests(generated_requests)
    TestCase.assertEqual(self, first=1, second=len(self.couchdb.get_requests(structure)))
    self.couchdb.delete_request(self.couchdb.get_requests(structure)[0])
    TestCase.assertEqual(self, first=0, second=len(self.couchdb.get_requests(structure)))

Inherited members

• DocumentTest:
  • setUp
  • tearDown

class LimitsTest (methodName='runTest')

A class whose instances are single test cases.

By default, the test code itself should be placed in a method named 'runTest'.

If the fixture may be used for many test cases, create as many test methods as are needed. When instantiating such a TestCase subclass, specify in the constructor arguments the name of the test method that the instance is to execute.

Test authors should subclass TestCase for their own tests. Construction and deconstruction of the test's environment ('fixture') can be implemented by overriding the 'setUp' and 'tearDown' methods respectively.

If it is necessary to override the init method, the base class init method must always be called. It is important that subclasses should not change the signature of their init method, since instances of the classes are instantiated automatically by parts of the framework in order to be run.

When subclassing TestCase, you can set these attributes: * failureException: determines which exception will be raised when the instance's assertion methods fail; test methods raising this exception will be deemed to have 'failed' rather than 'errored'. * longMessage: determines whether long messages (including repr of objects used in assert methods) will be printed on failure in addition to any explicit message passed. * maxDiff: sets the maximum length of a diff in failure messages by assert methods using difflib. It is looked up as an instance attribute so can be configured by individual tests if required.

Create an instance of the class that will use the named test method when executed. Raises a ValueError if the instance does not have a method with the specified name.

Expand source code

class LimitsTest(DocumentTest):
    __database = "limits-test"
    __database_type = "limits"

    def compare_limits(self, structure1, structure2):
        for resource in ["cpu", "mem", "disk", "net", "energy"]:
            if structure1["resources"][resource] != structure2["resources"][resource]:
                return False

        for key in ["type", "name"]:
            if structure1[key] != structure2[key]:
                return False

        return True

    def setUp(self):
        super().set_database(self.__database_type, self.__database)
        super().setUp()

    def testLimits(self):
        limits = base_limits
        structure = dict(base_container)

        with self.assertRaises(ValueError):
            self.couchdb.get_limits(structure)
        TestCase.assertEqual(self, first=0, second=len(self.couchdb.get_all_limits()))

        self.couchdb.add_limit(limits)

        retrieved_limits = self.couchdb.get_limits(structure)
        TestCase.assertEqual(self, first=1, second=len(self.couchdb.get_all_limits()))
        TestCase.assertTrue(self, self.compare_limits(limits, retrieved_limits))

        modified_limits = retrieved_limits
        modified_limits["resources"]["cpu"]["upper"] += 100

        TestCase.assertTrue(self, self.couchdb.update_limit(modified_limits))
        retrieved_limits = self.couchdb.get_limits(structure)
        TestCase.assertEqual(self, first=1, second=len(self.couchdb.get_all_limits()))
        TestCase.assertTrue(self, self.compare_limits(modified_limits, retrieved_limits))

Ancestors

• DocumentTest
• unittest.case.TestCase

Methods

def compare_limits(self, structure1, structure2)

Expand source code

def compare_limits(self, structure1, structure2):
    for resource in ["cpu", "mem", "disk", "net", "energy"]:
        if structure1["resources"][resource] != structure2["resources"][resource]:
            return False

    for key in ["type", "name"]:
        if structure1[key] != structure2[key]:
            return False

    return True

def testLimits(self)

Expand source code

def testLimits(self):
    limits = base_limits
    structure = dict(base_container)

    with self.assertRaises(ValueError):
        self.couchdb.get_limits(structure)
    TestCase.assertEqual(self, first=0, second=len(self.couchdb.get_all_limits()))

    self.couchdb.add_limit(limits)

    retrieved_limits = self.couchdb.get_limits(structure)
    TestCase.assertEqual(self, first=1, second=len(self.couchdb.get_all_limits()))
    TestCase.assertTrue(self, self.compare_limits(limits, retrieved_limits))

    modified_limits = retrieved_limits
    modified_limits["resources"]["cpu"]["upper"] += 100

    TestCase.assertTrue(self, self.couchdb.update_limit(modified_limits))
    retrieved_limits = self.couchdb.get_limits(structure)
    TestCase.assertEqual(self, first=1, second=len(self.couchdb.get_all_limits()))
    TestCase.assertTrue(self, self.compare_limits(modified_limits, retrieved_limits))

Inherited members

• DocumentTest:
  • setUp
  • tearDown

class StructureTest (methodName='runTest')

A class whose instances are single test cases.

By default, the test code itself should be placed in a method named 'runTest'.

If the fixture may be used for many test cases, create as many test methods as are needed. When instantiating such a TestCase subclass, specify in the constructor arguments the name of the test method that the instance is to execute.

Test authors should subclass TestCase for their own tests. Construction and deconstruction of the test's environment ('fixture') can be implemented by overriding the 'setUp' and 'tearDown' methods respectively.

If it is necessary to override the init method, the base class init method must always be called. It is important that subclasses should not change the signature of their init method, since instances of the classes are instantiated automatically by parts of the framework in order to be run.

When subclassing TestCase, you can set these attributes: * failureException: determines which exception will be raised when the instance's assertion methods fail; test methods raising this exception will be deemed to have 'failed' rather than 'errored'. * longMessage: determines whether long messages (including repr of objects used in assert methods) will be printed on failure in addition to any explicit message passed. * maxDiff: sets the maximum length of a diff in failure messages by assert methods using difflib. It is looked up as an instance attribute so can be configured by individual tests if required.

Create an instance of the class that will use the named test method when executed. Raises a ValueError if the instance does not have a method with the specified name.

Expand source code

class StructureTest(DocumentTest):
    __database = "structures-test"
    __database_type = "structures"

    def setUp(self):
        super().set_database(self.__database_type, self.__database)
        super().setUp()

    def compare_structures(self, structure1, structure2):
        def compare_resources(resources1, resources2):
            for resource in ["cpu", "mem", "disk", "net", "energy"]:
                if resources1[resource] != resources2[resource]:
                    return False

        for key in ["type", "subtype", "guard_policy", "host", "host_rescaler_ip", "host_rescaler_port", "name",
                    "guard"]:
            if structure1[key] != structure2[key]:
                return False
        compare_resources(structure1["resources"], structure2["resources"])

        return True

    def testStructures(self):
        structure = dict(base_container)
        with self.assertRaises(ValueError):
            self.couchdb.get_structure(structure["name"])
        TestCase.assertEqual(self, first=0, second=len(self.couchdb.get_structures()))

        self.couchdb.add_structure(structure)
        retrieved_structure = self.couchdb.get_structure(structure["name"])
        TestCase.assertEqual(self, first=1, second=len(self.couchdb.get_structures()))
        TestCase.assertTrue(self, self.compare_structures(structure, retrieved_structure))

        modified_structure = retrieved_structure
        modified_structure["policy"] = "fixed"
        modified_structure["guard_policy"] = False
        modified_structure["resources"]["cpu"]["min"] += 100

        TestCase.assertTrue(self, self.couchdb.update_structure(modified_structure))
        retrieved_structure = self.couchdb.get_structure(structure["name"])
        TestCase.assertEqual(self, first=1, second=len(self.couchdb.get_structures()))
        TestCase.assertTrue(self, self.compare_structures(modified_structure, retrieved_structure))

Ancestors

• DocumentTest
• unittest.case.TestCase

Methods

def compare_structures(self, structure1, structure2)

Expand source code

def compare_structures(self, structure1, structure2):
    def compare_resources(resources1, resources2):
        for resource in ["cpu", "mem", "disk", "net", "energy"]:
            if resources1[resource] != resources2[resource]:
                return False

    for key in ["type", "subtype", "guard_policy", "host", "host_rescaler_ip", "host_rescaler_port", "name",
                "guard"]:
        if structure1[key] != structure2[key]:
            return False
    compare_resources(structure1["resources"], structure2["resources"])

    return True

def testStructures(self)

Expand source code

def testStructures(self):
    structure = dict(base_container)
    with self.assertRaises(ValueError):
        self.couchdb.get_structure(structure["name"])
    TestCase.assertEqual(self, first=0, second=len(self.couchdb.get_structures()))

    self.couchdb.add_structure(structure)
    retrieved_structure = self.couchdb.get_structure(structure["name"])
    TestCase.assertEqual(self, first=1, second=len(self.couchdb.get_structures()))
    TestCase.assertTrue(self, self.compare_structures(structure, retrieved_structure))

    modified_structure = retrieved_structure
    modified_structure["policy"] = "fixed"
    modified_structure["guard_policy"] = False
    modified_structure["resources"]["cpu"]["min"] += 100

    TestCase.assertTrue(self, self.couchdb.update_structure(modified_structure))
    retrieved_structure = self.couchdb.get_structure(structure["name"])
    TestCase.assertEqual(self, first=1, second=len(self.couchdb.get_structures()))
    TestCase.assertTrue(self, self.compare_structures(modified_structure, retrieved_structure))

Inherited members

• DocumentTest:
  • setUp
  • tearDown