This application discloses methods for creating self-organizing networks implemented on heterogeneous mesh networks. The self-organizing networks can include a computing cloud component coupled to the heterogeneous mesh network. In the methods and computer-readable mediums disclosed herein, a processor receives an environmental condition for a mesh network. The processor may have measured the environmental condition, or it could have received it from elsewhere, e.g., internally stored information, a neighboring node, a server located in a computing cloud, a network element, user equipment ("UE"), and the like. After receiving the environmental condition, the processor evaluates it and determines whether an operational parameter within the mesh network should change to better optimize network performance.

FIELD

The present application relates to systems and methods of performing self-organizing techniques in mesh communication networks. The self-organizing network ("SON") modules disclosed herein have the ability to self-optimize, self-heal, or self-configure a wireless, mesh communication network.

BACKGROUND

The total capital expenditures required to keep pace with consumer demands being placed on wireless communication networks is increasing significantly. As wireless networks become more complex and more ubiquitous, the costs associated with establishing, provisioning, and maintaining these networks continues to rise. One of the reasons these costs continue to rise is the high level of skill required to establish, manage, and maintain these networks. From the nascent stages of network design through the more mundane tasks of ensuring operability, highly skilled individuals play significant roles in the continued functioning of our wireless networks.

Recently, wireless communication providers have begun to automate some of the tasks associated with network provisioning and maintenance using SON techniques that self-configure, self-optimize, and self-heal. SON solutions are primarily being implemented in either the LTE access portion of eNodeBs, or within a central management node, but not on the backhaul portion of the eNodeBs. An eNodeB is the combined radio interface and radio network controller in an LTE station.

These prior implementations have drawbacks because, for example, when SON techniques occur only at the eNodeB level, each eNodeB has a limited view of the entire network. In most networks, an eNodeB does not see network operational parameters and environmental conditions external to itself. As a result, eNodeBs are typically limited in their ability to make dynamic operational changes. Similarly, when a central management node implements SON techniques, the typical flow involves a network management node asking an operations management node if any of the eNodeBs under its operational control are experiencing interference. In order to answer that question, the operational management node queries the eNodeBs under its control. Once it has received all of the responses from each of the eNodeBs under its management, it compiles these data and makes a determination about whether it should instruct any of the eNodeBs to change operational parameters.

The types of SON implementations currently being employed are primarily focused on auto-provisioning and interference mitigation. In current deployments, network resources such as Wi-Fi and 3G/4G antennas and Ethernet links are configured as either access or backhaul. Generally, that role persists for the life of the product. If a SON module could be used to make these roles more dynamic, networks could be more flexible and could provision themselves on-the-fly so as to overcome network isolation and maximize network efficiency.

In another example, if a certain portion of a frequency band has a transmit power restriction placed upon it, network operators typically do not use that portion of the band because it is challenging to create different power profiles for certain sub-channels or sub-carrier frequencies. Restrictions are typically placed on a portion of a frequency band to avoid interference. These restrictions can be e.g., adding a buffer zone, creating a guard band, and the like. The frequency-band nature of electronic components makes it difficult to control the power of certain sub-carrier frequencies, or sub-channels, within the band using static electronic components. If, however, SON techniques could be applied to this scenario, it would be possible to obtain more capacity out of frequency bands having restrictions.

While the concept of SON is clearly an attractive one given its ability to reduce costs and resolution time of issues when they arise in the network, there is a need to apply the principles of SON to a wider array of wireless communication protocols, frequency ranges, access and backhaul, and the like. Similarly, it is desirable to design SON modules that can integrate these disparate technologies, protocols, network pathways and the like by leveraging the strengths of each within a particular network in a hybridized fashion, and on a real-time basis. In addition, in a mesh network, where nodes are more autonomous than in traditional networks, adding SON capabilities to the mesh topology would enhance the performance of these networks as well.

DETAILED DESCRIPTION

The systems and methods disclosed herein can be used with heterogeneous mesh networks. Although mesh networks have been deployed in the past, these networks have not contained nodes capable of autonomously using SON techniques, nor have they contained nodes capable of working jointly with a computing cloud component. Before discussing the specifics of the architecture, we will provide some background information on the mesh networks within which our SON modules will operate. The mesh networks of the present invention are capable of: (1) operating on white-space frequencies; (2) dynamically switching roles; (3) autonomously using SON techniques; (4) operating within a heterogeneous environment; and (5) using layered SON modules in conjunction with a computing cloud or a software defined network server.

The mesh networks of this invention differ conceptually from prior art gateway paradigms because the custom designed layer stacks of this invention abstract the protocols that make each radio technology unique, thereby creating an agnostic data set that can be seamlessly routed throughout a wireless network. In embodiments of this invention, individual nodes operating on different protocols, different frequencies, different hardware manifestations, or different duplexing schemes can be part of a dynamic mesh network because of the aforementioned abstraction. This dynamic mesh network uses a single routing table for heterogeneous nodes contained within the mesh network.

Mesh Networks

The term "mesh network" is typically defined as a network comprised of two or more nodes wherein the nodes act as routers. Illustratively, an online encyclopedia from PC Magazine defines a mesh network as follows: "(1) [a] network that relies on all nodes to propagate signals. Although the wireless signal may start at some base station (access point) attached to a wired network, a wireless mesh network extends the transmission distance by relaying the signal from one computer to another . . . . (2) A network that provides Wi-Fi connectivity within an urban or suburban environment. It comprises ‘mesh routers,‘ which are a combination base station (access point) and router in one device. Also called ‘mesh nodes,‘ they are typically installed on street light poles, from which they obtain their power." PC Mag.com Encyclopedia, www.pcmag.com/encyclopedia/term/54776/wireless-mesh-network

Similarly, another online source states: mesh "networks rely on a series of nodes that transfer data wirelessly. Each node acts as an individual router, so the network can constantly reroute data to take advantage of the best pathways. It allows information to ‘hop‘ from one node to another, circumventing blocked or broken paths in the network. Unlike other wireless networks, mesh networks use nodes that are all fully connected to one another, so the nodes are not mobile, but they can be easily configured to form ad hoc networks." Power Source Online, Mesh Networks, Kristin Masters March 2010. www.powersourceonline com/magazine/2010/03/mesh-networks

As used in this application, we define the term "dynamic mesh node" as a mesh node that is capable of playing a dynamic role within a network. A dynamic role could mean, by way of example, being capable of being a client with respect to one node and a server with respect to another node in the network, or instantly switching from a client role to a server role. Dynamic can also mean switching radio access technologies. Prior art mesh nodes did not have the ability to play a dynamic role within a network. Rather, they acted as a base station access point and router. These roles were predetermined. The nodes within the mesh networks did not dynamically function as a client to one node, and a server to another, nor did they dynamically change transmit frequencies or protocols, for example.

Multiple Radio Access Technology ("multi-RAT") Nodes

The concept of multiple radio access technology will also be defined. The term "radio access technology" indicates the type of radio technology used to access a core network. Multiple radio access technology, or multi-RAT, is a radio technology capable of operating in varying parameters. These varying radio parameters could be, for example, different protocols, different duplexing schemes, different media access methods, disparate frequency bands, and the like. The multi-RAT nodes, upon which SON embodiments operate are dynamic mesh nodes.

By disparate frequency bands, we mean frequencies from different categories of standards, or from generally accepted frequency ranges for a given technology. For example, the Wi-Fi protocol standard is currently authorized for use at two different frequencies in the United States, 5 GHz according to the 802.1a standard and 2.4 GHz according to the 802.1b standard. However, the message format, media access method, etc. are identical regardless of the frequency used. Thus, in our lexicography, a device that could communicate using Wi-Fi at both 5 GHz and 2.4 GHz would not be a multi-RAT device or node because both of these frequencies are considered within the art to represent instances of the Wi-Fi protocol. An example of a radio capable of operating in disparate frequency bands would be a radio that could operate in a Wi-Fi band of either 2.4 GHz or 5 GHz and that same radio could also operate at 700 MHz or any other cellular frequency band, which requires a different media access method and/or a different message format. This type of a radio is an example of a multi-RAT node.

Similarly, we use the term "heterogeneous mesh network" to mean at least two dynamic mesh nodes capable of: using different access protocols, or different duplexing schemes, or operating in disparate frequency bands, or using different transport media, such as wired versus wireless. Different protocols may include Wi-Fi, 2G, 3G, 4G, WCDMA, LTE, LTE Advanced, ZigBee, or Bluetooth. Different duplexing schemes may include time division, code division, and frequency division schemes. Disparate frequency bands may include so-called "whitespace" VHF and UHF channels, cellular telephony bands, public safety bands, and the like.

The SON modules disclosed herein were designed to operate in multi-RAT nodes and/or on a computing cloud. These embodiments perform self-optimization, self-organization, and self-healing on both the access and backhaul sides of the network. The multi-RAT nodes of the present invention have hardware, firmware, and software aspects. Focusing on the multi-RAT nodes,?FIG. 1?shows hardware that could be used in embodiments of this invention. A multi-RAT node?100?is comprised of at least one processor?110, a memory device?115, access hardware?120, backhaul hardware?130, an RF front-end?140, and a timing source?150. By way of example, the memory device?115?could contain SON modules, which could be written in Linux. Additionally, the RF front-end?140?can be configured to provide RF capabilities for multiple radio access technologies.

In one embodiment, the timing source could be GPS. Alternatively, the timing source could be derived from the Ethernet, or an IEEE 1588 source, such as SyncE, PTP/1588v2, and the like. In an alternate embodiment, wherein one multi-RAT node100?may have access to GPS time, but another multi-RAT node?100?may be indoors, the two multi-RAT nodes?100?could use differential time synching techniques well known to those of skill in the art, so that the indoor multi-RAT node?100?could sync its timing with that of the outdoor multi-RAT node?100. In another embodiment, the multi-RAT node?100?could be a dynamic multi-RAT node.

In alternate embodiments, the processor?110, could be broken down into an access processor?112, a backhaul processor114, a common processor?116, or any combination thereof. Each additional processor would also be coupled to the memory device?115. In this embodiment, the access hardware?120?is coupled to the processor?110. In an alternate embodiment, having a separate access processor?112, the access hardware?120?could be coupled to the access processor112, to the processor?110, or to the common processor?116, or any combination thereof. Similarly, in another alternate embodiment, having a separate backhaul processor?114, the backhaul hardware?130?could be coupled to the backhaul processor?114, to the common processor?110, or to the common processor?116, or any combination thereof.

In alternate embodiments, the SON modules could be stored on a processor or a server located within a computing cloud. In these embodiments, the SON modules stored in the computing cloud are communicatively coupled to a multi-RAT node100?so as to effectuate a layered SON management architecture. Similarly, computing clouds could employ a layered SON architecture whereby the servers could be communicatively coupled via an XML-based interface or similar interface.

Those skilled in the art will appreciate that access and backhaul hardware will vary, depending on the access or backhaul protocol or frequency being used. By way of example, if a particular multi-RAT node?100?was designed to perform access on LTE and Wi-Fi, it could have the radio access technology components that would perform access on these two different protocols. For LTE access, the access hardware?120?could be comprised of: a baseband processor and CPU cores for the firmware. The baseband processor could generate digital RF signals, which are modulated by the RF front end?140. These processors could be connected to the RF front end?140?via common public radio interfaces. Alternatively, some or all of the necessary radio access technology may incorporate Commercial Off-the-Shelf (COTS) hardware/firmware devices, such as conventional Wi-Fi access hardware based on Wi-Fi chips with embedded firmware and one or more external antennas.

Those skilled in the art will recognize that multiple hardware configurations could be used depending upon the access protocol, backhaul protocol, duplexing scheme, or operating frequency band by adding or replacing daughter cards to the dynamic multi-RAT node?100. Presently, there are off-the-shelf radio cards that can be used for the varying radio parameters discussed herein. Accordingly, the multi-RAT nodes?100?of the present invention could be designed to contain as many radio cards as desired given the radio parameters of heterogeneous mesh networks within which the multi-RAT node?100?is likely to operate. Those of skill in the art will recognize that, to the extent an off-the shelf radio card is not available to accomplish transmission/reception in a particular radio parameter, a radio card capable of performing, e.g., in white space frequencies, would not be difficult to design.

Similarly, in the present invention, we describe how to make and use the inventions operating within well-known industry protocols. To the extent that additional protocols are adopted in the future, the teachings herein would be equally applicable. Additionally, if a person of skill in the art were to modify an already known protocol, such as LTE, and make it into a proprietary LTE protocol, for example, the teachings of this patent application would be equally applicable; and embodiments described herein could be adapted to accommodate this proprietary protocol.

Software-Defined Networking ("SDN")

In the SDN architecture, the control and data planes are decoupled, network intelligence and state are logically centralized, and the underlying network infrastructure is abstracted from the applications. SDN allows network administrators to manage network services more easily through abstraction of lower level functionality into virtual services.

The SDN architecture departs from legacy solutions by building networks from three abstractions or layers. See generally "Build the Foundation for SDN with OpenFlow," HP Business White Paper, February 2013. First, the infrastructure layer acts as the foundation for an SDN architecture. The infrastructure consists of both physical and virtual network devices such as switches and routers. These devices implement the OpenFlow protocol as a standards-based method of implementing traffic forwarding rules.

Second, the control layer consists of a centralized control plane for the entire network. The control plane is decoupled from the underlying infrastructure to provide a single centralized view of the entire network. The control layer utilizes OpenFlow to communicate with the infrastructure layer. Third, the application layer consists of network services, orchestration tools, and business applications that interact with the control layer. These applications leverage open interfaces to communicate with the control layer and the network state.

At the foundation of enabling SDN is an emerging open standard called OpenFlow, which ultimately allows the network to be more responsive to business needs. OpenFlow has been in development since 2007, led by Stanford University and the University of California at Berkeley. It became a standard that is now defined by the Open Networking Foundation (ONF) since 2011. OpenFlow hides the complexity of the individual pieces of network devices. OpenFlow centralizes the control of those devices in a virtualized manner, simplifying network management.

The OpenFlow protocol uses a standardized instruction set, which means that any OpenFlow controller can send a common set of instructions to any OpenFlow-enabled switch, regardless of vendor. OpenFlow is an open-standards way of virtualizing the network. Network managers can specify different policy rules for different groups of devices and users, which create multiple virtualized networks regardless of the physical network connections. This allows network managers to customize and manage these virtualized networks to ensure proper policies such as forwarding path, QoS, and security.

In embodiments of the present invention, an SDN controller or gateway operating under the OpenFlow standard could be coupled to the heterogeneous mesh network. In these embodiments, the SDN controller would also be able to communicate with any additional OpenFlow devices within its range irrespective of whether those devices were a part of the heterogeneous mesh network.

Self-Organizing Network "SON"

Those of skill in the art will recognize that the term "SON" is a frequently used concept, but one that is devoid of a standard way of implementing the principles of self-organization that the moniker implies. As a result, SON embodies principles of self-organization, typically performed on the access side by using proprietary architecture on homogeneous networks.

In the present invention, because most of the mesh networks described herein are heterogeneous, it follows naturally that any SON implementations would be able to operate in a heterogeneous network. Against this backdrop, we use the term "SON" throughout this application to mean the traditional functionality of SON, i.e., self-organization, self-optimization, auto-configuration, self-healing, and the like, applied on a heterogeneous network, as that term is used throughout this patent application, on both the access and backhaul sides. The SON principles described herein could also be used on the white-space embodiments discussed below.

For illustrative purposes, we will describe SON functionality in an exemplary wireless mesh network?200?shown in?FIG. 2. In this embodiment, multi-RAT node?210?is providing access on LTE, multi-RAT node?220?is providing access on Wi-Fi, and multi-RAT node?230?is providing access on 3G. In this embodiment, the multi-RAT nodes?210,?220,?230?could be using Wi-Fi backhaul. The wireless backhaul links,?215,?217, and?225?are shown as dashed lines, while a wired backhaul link?235?is shown as a solid line. This embodiment is one example of a heterogeneous mesh network.

In some embodiments herein, the SON architecture, discussed more fully with reference to?FIG. 3, is distributed between a computing cloud?240?and the multi-RAT nodes?210,?220,?230. In these hybrid SON embodiments, the SON modules located in the computing cloud?240?have a high-level view of the network, comprised of multi-RAT nodes?210,?220, and?230. This high-level view allows the SON embodiments of this invention to make larger scale, intelligent decisions by leveraging the strengths and weaknesses of the various radio technologies available within a network at any given time. Additional embodiments include multi-layered SON modules wherein a first layer of SON modules, residing within a multi-RAT node210,?220, or?230?could be managed by a SON module located within a computing cloud?240, which in-turn could be managed by another SON module located on a network server, on an alternate cloud, or the like. In this layered topology, there could be an interface between servers such as an XML-based interface.

FIG. 3?shows a custom designed architecture?300?that can be used in embodiments of the present invention. Specifically, the custom designed architecture?300?of these embodiments builds upon the well-known Layer 1 (Physical Layer), Layer 2 (Datalink), Layer 3 (Network Layer), Layer 4 (Transport Layer), Layer 5 (Application Layer), Control Plane or Layer, and Management Plane or Layer architecture of the prior art. This custom designed architecture resides within multi-RAT nodes and computing cloud embodiments of the present invention.

In our custom designed architecture?300, we add an abstraction layer?340, a SON module?330, and in addition add customizations to the other modules so that they can interoperate with the abstraction layer?340?and the SON module?330. Specifically, our custom designed architecture?300?includes a management layer?380, an application layer?310, a control layer?320, and an abstraction layer?340. The abstraction layer?340?is communicatively coupled to at least one radio. For example, the embodiment of?FIG. 3, which could be operational on a multi-RAT node of the present invention, shows three multi access technology radios. One of these radios is an LTE radio?370. One is a Wi-Fi radio?360. And the third is radio technology X?350?which as one example and without limitation could be a point-to-point microwave radio link. Once there are at least two radio access technologies within a single node, the node becomes a multi-RAT node as described herein. As can be seen from?FIG. 3, additional radios?350?could be added to create multi-RAT nodes having X number of access technologies.

The abstraction layer?340?provides a common API interface to the layers above it. The abstraction layer?340?receives data from each of the radios beneath it and converts those data into protocol agnostic data. In some embodiments, the SON module?330?interfaces with complimentary SON modules stored on a server, processor, or the like, in a computing cloud240?in order to perform network optimization.

In terms of customization of the modules within the control layer?320, the traffic control module?325?has the flexibility to create data queues based on priority without regard to radio access technology. The automatic neighbor relation management module?326?acts as an interface between the multiple radio access technologies so that neighbors within a particular mesh network become aware of the various resources provided by each node within the network.

In some embodiments, the power management module?324?and/or the radio resource management module?322?can interface with the SON module?330?to increase or decrease power, to change channels, and the like in order to optimize network operating conditions. The changes are performed on a real-time or near real-time basis, which substantially enhances network performance.

For illustration, assume that the custom designed architecture?300?was operational on a multi-RAT node having two radio technologies, LTE?370?and Wi-Fi?360. In this embodiment, data could be received through the LTE radio?370. These data would be received in Layer 1 of the LTE radio?370. They would proceed up through Layer 2 and Layer 3 to the abstraction layer?340. The abstraction layer?340?could abstract the LTE-specific information from the data packet and could send a protocol agnostic data stream to the control layer?320. The control layer?320?could then decide the routing, which in this case could be through either the LTE radio?370?or the Wi-Fi radio?360. In embodiments of the present invention, multi-RAT nodes use and create distributed routing protocols that perform L2 bridging through an abstraction layer?340.

From a high level perspective, when embodiments of the SON modules are run on processors, they perform steps that measure an environmental condition, store the environmental condition in memory, evaluate the environmental condition, and determine whether an operational parameter should be altered based upon the environmental condition. If the SON module is being run exclusively at the multi-RAT level, hardware within the multi-RAT node will perform these method steps. For example, if the environmental condition is a signal strength measurement of a neighboring node, the receiver within the multi-RAT node can measure the signal strength of its neighbor.

If the SON module is being executed from within a computing cloud, the SON module in the computing cloud could obtain the measurement of an environmental condition either from a multi-RAT node within a network it is managing, from internal stored memory, or by querying additional network elements to which the computing cloud is communicatively coupled. For example, if the environmental condition is a quality of service measurement, the computing cloud could obtain that information from the EPC (Evolved Packet Core).

It is well known in the art that certain systemic conditions affect network performance. We refer to these conditions as "environmental conditions." While we have listed many of the environmental conditions that affect network performance, this list is not meant to be exhaustive, but merely illustrative of what those skilled in the art understand regarding the effect of environmental conditions on network performance.

At various points in time, mesh networks can include multi-RAT nodes, user equipment communicatively coupled to multi-RAT nodes, and/or a computing cloud. From the network‘s perspective, therefore, environmental conditions and operational parameters exist for all of these participants within the mesh network.

In some embodiments, multi-RAT nodes have hybrid SON functionality, which provides intelligence gleaned by measuring, determining, or evaluating an environmental condition. In alternate embodiments, SON modules within a computing cloud operate from a higher network perspective, providing SON functionality for the network, which includes multi-RAT nodes having access and backhaul capabilities. In yet alternate embodiments, these SON modules can work together in a layered fashion. For example, a partial operation data cache could be maintained in a multi-RAT node‘s hardware, while the next level of SON functionality could be provided by modules located within a computing cloud. In still alternate embodiments of SON modules, SON modules located on a computing cloud server could act as an umbrella macro by managing multiple small cells underneath it, while simultaneously being managed by SON modules located on another server at a macro-network level.

FIG. 4?illustrates the general steps of embodiments of SON modules described herein, namely receiving?410?an environmental condition, storing?415?the environmental condition, evaluating?420?the environmental condition, determining430?if an operational parameter should be changed, and changing?435?the environmental condition. These general steps are performed for numerous embodiments irrespective of whether the processor containing the SON module that is being executed is located in a multi-RAT node?210,?220,?230?or on a server located in a computing cloud?240. If the SON module is located on a server in a computing cloud?240?it may measure an environmental condition by querying a multi-RAT node210?m?220,?230, an EPC, or the like as discussed previously.

Some of the environmental conditions regarding a heterogeneous mesh network include: an interference measurement, a capacity measurement, a spectrum efficiency measurement, routing path, a network congestion measurement, a throughput measurement, a latency measurement, a coverage gap, a signal-to-noise ratio, a quality-of-service measurement, a radio-bearer utilization value, an available portion of spectrum, a load balancing measurement, status of an operating heterogeneous mesh network, status of a multi-RAT node within the heterogeneous mesh network, identifying information regarding a multi-RAT node, status of a wired connection within the heterogeneous mesh network, a frequency restriction, a signal strength measurement of neighboring multi-RAT node, a request to join the heterogeneous mesh network, or the existence of a hidden node, and the like.

In an alternate embodiment, the SON modules described herein could be harmonized with an external third-party network having its own set of environmental conditions and operational parameters. These third-party environmental conditions or third-party operational parameters could be any of the environmental conditions or operational parameters described herein with respect to the SON network. In these embodiments, an XML-based interface could facilitate communication between a computing cloud server or a multi-RAT node containing SON modules described herein and the third party network. When the SON module receives a third-party environmental condition or a third-party operational parameter, such as an operating frequency, it can adjust an operational parameter within its own internal network, for example, by altering the operating frequency of a multi-RAT node that may be experiencing interference related to its proximity to the third-party network. The harmonization between the SON networks described herein and third-party networks could serve to greater utilize resources between both the SON networks and the third-party networks by, for example, mitigating interference, coordinating handoffs, sharing unused spectrum, and the like.

Environmental conditions specific to multi-RAT nodes include: a multi-RAT node identification number, an identification number for software stored in a multi-RAT node, a security parameter, a location of a multi-RAT node, a configuration certificate of a multi-RAT node, an authentication request, an operating frequency, or a handoff request, and the like.

Environmental conditions relating to specific user equipment being serviced by multi-RAT nodes can also be measured and relayed to multi-RAT nodes within the mesh network. Some of these environmental conditions, which could also be processed by the disclosed SON embodiments, include: a range from a user equipment to a multi-RAT node, travel direction of a user equipment, a travel speed of a user equipment, a signal strength of a user equipment, a location of a user equipment, or a mapping application stored on a user equipment, an operational channel, and the like.

The aforementioned environmental conditions could be measured by a multi-RAT node?210,?220,?230. They could be calculated within a processor on a multi-RAT node?210,?220,?230?or in a computing cloud?240. Similarly, they could be stored in cached memory within a multi-RAT node?210,?220,?230?or in a computing cloud?240.

The operational parameters that can be adjusted include: power level, channel, sub-channel, frequency band, sub-carrier frequency, spectrum allocation, access configuration, backhaul configuration, client, server, routing path, IP address, self-configuration instance, fully qualified domain name ("FQDN"), dynamic host configuration protocol ("DHCP") address, backhaul configuration, network provider (e.g., AT&T, Verizon, T-Mobile, and the like), participation within a mesh network, and the like.

After executing the steps depicted in?FIG. 4, embodiments of SON modules disclosed herein could alter a panoply of operational parameters to automatically enhance network performance. By way of example, and without limiting the scope of the claims, SON module embodiments could perform the following functions: (1) node provisioning; (2) network optimization by changing an operational parameter; (3) switching roles from access to backhaul; (4) reallocating underutilized spectrum within a network; (5) coordinating handoffs; (6) using white-space frequencies; (7) utilizing frequency bands when limitations have been placed on that band; (8) deciding whether to connect to a small cell; (9) authenticating new nodes by using a client-server authentication; and (10) solving the "hidden node" problem.

(1) Node Provisioning

In some embodiments, nodes can be pre-provisioned in such a way that installing a new network could be accomplished using SON modules, as opposed to using manual provisioning techniques as is currently done. Embodiments of this invention, can be used by various network providers in myriad geographic locations even though the configuration files may be slightly different based upon the identity of the network operator or the geographic location of the mesh network. The SON functionality modules that provide node provisioning can automatically provision new equipment with the proper configuration files that take into account the network operator and the geographic location of the mesh network. In addition, these SON modules can dynamically discover and connect to a computing cloud?240.

In embodiments having this SON module, multi-RAT nodes could come out of the factory having a minimum configuration file stored in internal memory as well as the initial software necessary to operate as a mesh node in the heterogeneous mesh networks disclosed herein. The minimum configuration file could include, for example, a node ID, a pre-configured FQDN, licensing information, security parameters, such as certificates, and backhaul configuration information. These new nodes could be programmed with configuration data related to geographic location and network provider information by employing a SON module embodiment. In this embodiment, a multi-RAT node could have a radio discovery module, which allows it to identify and communication with other radio nodes that are within range, and a configuration download module that installs the remaining configuration parameters based upon the location at which the node is intended to operate. A further embodiment may provide configuration information sufficient for the multi-RAT node to communicate with its peers using only unlicensed frequencies, allowing it to then obtain further configuration information including location-dependent licensing information. This configuration download module could, by way of example, determine the geographic location of the node through GPS, location reports from other radios within range, pre-set information, or the like.

In this embodiment, the new node could have preset factory default configurations stored in an internal memory. The SON module that enables these embodiments follows the general method steps outlined with reference to?FIG. 4. Specifically, after the node has been powered up, it could receive?410?and store?415?an environmental condition, such as whether it detects an existing mesh network, identifying information regarding nodes, signal strength of neighboring nodes, and the like. These measurements could be made by the receiving hardware in the multi-RAT node. After receiving?410?and storing415?an environmental condition, the SON module embodiments could, using a processor within the multi-RAT node, evaluate420?the environmental condition and determine?430?if an operational parameter should be adjusted. Examples of operational parameters that could be adjusted in this embodiment are IP address, FQDN for a management module stored on a computing cloud using a configured or discovered DNS server, and the like. It is possible to perform the steps of this embodiment more than once in order to provision a new small cell or network.

Focusing on changing an FQDN, this embodiment of the present SON invention allows a multi-RAT node?210,?220, or?230?to optimize its selection of a computing cloud?240?with which to connect. Specifically, it is desirable for a multi-RAT node?210,220, or?230?to connect to the closest computing cloud?240?it can find because the closer the computing cloud?240, the less latency in the network. In this embodiment, a multi-RAT node?210,?220, or?230?could receive?410?an environmental condition, such as its location, from either an internal GPS, location reports from other radios within range, preset information, and the like. After the multi-RAT node?210,?220, or?230?receives?410?location information, it could store?415that information in internal memory, if it is not already stored there such is in the case of preset location information.

Once the multi-RAT node?210,?220, or?230?has determined its location, it can evaluate?420, based on its location, to which computing cloud?240?it should connect. The evaluation?420?could occur as follows: (1) the multi-RAT node?210,?220, or?230can form an FQDN with its location embedded within it; (2) it can then query a DNS server to determine if there is a computing cloud?240?serving its area; (3) the multi-RAT node?210,?220, or?230?can go through DNS procedures such as NAPTR to create a list of candidate computing clouds?240?to which it could connect; (4) the multi-RAT node?210,?220, or230?could then match its initial FQDN against the host names associated with the candidate computing cloud?240?to select the longest match, i.e., the number of matching labels in the host FQDN; and (5) the multi-RAT node?210,?220, or?230?can authenticate the computing cloud?240?with the longest match. Once these steps are performed, the multi-RAT node?210,220, or?230?can determine?430?if it should change an operational parameter, such as an FQDN. If it determines?430?that it should change its FQDN, it can then change?435?the FQDN.

In alternate embodiments, if there are more than one optimal computing cloud?240?to which a multi-RAT node?210,?220, or230?could connect, the multi-RAT node?210,?220, or?230?could contain additional SON functionality that would allow it to consider additional load balancing among the two or more optimal computing clouds?240. Similarly, if the multi-RAT node210,?220, or?230?is unable to connect with its first choice for a computing cloud?240, it can elect to try to connect with the second best candidate computing cloud?240?from the list described above.

In an alternate embodiment, the multi-RAT node?210,?220, or?230?could store information related to computing cloud?240?to which it was unable to connect. This "blacklist" could be used by any multi-RAT node?210,?220, or?230?within the network that is evaluating?410?its location in order to determine?430?its FQDN. Once a computing cloud?240?has been placed on the blacklist, it could be removed as a viable computing cloud candidate for a certain period of time, called a dead interval. The dead interval could be determined in a number of ways. It could be a predetermined time interval. It could be derived using an exponential back-off mechanism whereby the more failures from that candidate computing cloud?240, the longer the node is blacklisted. In an alternate embodiment, a multi-RAT node?210,?220, or?230?could perform periodic out-of-band signaling with the blacklisted computing cloud?240?to determine if it is reachable and functioning properly. In an alternate embodiment, the out-of-band communications could be combined with the exponential back-off method to create a heuristics-based approach.

In order to make the radio network more flexible from the deployment point-of-view, it may be desirable to introduce a node discovery mechanism that allows multi-RAT nodes to discover network elements as they are plugged in. This node discovery module capability could be part of the SON module embodiments described herein with respect to node provisioning. Optionally, the node discovery capability could be used to locate a network node that has a wired backhaul link.?FIG. 5?shows the steps of a node discovery SON module of this embodiment.

Referring to?FIG. 5, a new multi-RAT node could broadcast?510?identifying information, such as its node ID, on Layer 1. In addition, the new multi-RAT node could scan to see if it can locate additional nodes. In this step, the new node‘s receiving equipment listens?515?for active transmitters in order to determine if there are other nodes within its range or neighborhood. Each node within a network could broadcast, e.g., on control time slots, its one-hop neighbors. Nodes that receive these broadcasts use this information to build an interference domain table, database, or similar data compilation.

If the new multi-RAT node finds an additional node, it can introduce?520?itself and can also send information regarding neighboring nodes it has discovered during the scanning step. The new node could determine?530?if the additional node has a wired backhaul link. If the additional node does not have a wired backhaul link, the new node could continue listening?515to see if it can discover a node that does have a wired backhaul link. If the additional node does have a wired backhaul link, the new node could obtain?635?the address of the dynamic host configuration protocol ("DHCP") server from the wired node.

In one embodiment, the wired node within this newly formed mesh network could be connected to a computing cloud?240, which may have SON management modules stored therewith. In this embodiment, the new node could determine?540?if the wired node is connected to a computing cloud?240. If the wired node is connected to a computing cloud?240, the new node could connect?545?to the DNS Server and resolve?550?the FQDN of the cloud component?240. In this embodiment, the new node could perform?555?authentication steps, e.g., identification credentials, software version information, and the like, with the SON management modules stored on the cloud component?240. The management module could authorize the new node for participation within the mesh network after, for example, authenticating its credentials. Additionally, the management module on the computing cloud could ensure that the software resident on the new node is the proper release version in order to allow the new node to participate within the mesh network. If it is not, the management module could provide the new node with the proper software and could instruct the new node to reboot. If the software on the new node is current, it can join the mesh network.

In an alternate embodiment, a SON module could execute a method for integrating a new multi-RAT node into a pre-existing heterogeneous mesh network. This embodiment follows the general method steps depicted in?FIG. 4. Specifically, after the node has been powered up, it could receive?410?and store?415?an environmental condition, such as whether it detects an existing mesh network, identifying information regarding nodes, signal strength of neighboring nodes, and the like. These measurements could be made by the receiving hardware in the multi-RAT node. After receiving?410?and storing?415?an environmental condition, the SON module embodiments could, using a processor within the multi-RAT node?210,?220, or230, evaluate?420?the environmental condition, determine?430?if an operational parameter should be adjusted, and change the operational parameter?435?if needed.

In this embodiment, the new multi-RAT node?210,?220, or?230?may not have pre-configuration data stored within its internal memory. At some point after the receiving hardware within the new multi-RAT node?210,?220, or?230?has detected a mesh network within its range, its internal logic could automatically begin taking steps so that the multi-RAT node?210,?220, or?230could join the mesh network. Referring to?FIG. 6, a SON module in this embodiment could execute?610?a self-test by running software stored within an internal processor in the multi-RAT node?210,?220, or?230. If the multi-RAT node?210,220, or?230?fails the self-test, it could send?620?a report to a Network Element Manager. If it passes the self-test, it contacts?630?a neighboring node, which may or may not have a connection to a computing cloud.

In order for the new node to join the mesh network, it must obtain a certain amount of information from its neighboring node, or optionally from a computing cloud?240?or an SDN controller?810. In one embodiment, the new node could receive?640?a self-configuration instance, such as configuration certificates, from its neighboring node, from a computing cloud?240, or from an SDN controller?810.

After the multi-RAT node?210,?220, or?230?receives?640?the self-configuration instance, it installs?650?the self-configuration instance and joins?660?the mesh network. The Network Element Manager and the Planning Tool can inform neighboring multi-RAT nodes?210,?220, or?230?about the new multi-RAT node?210,?220, or?230?that has joined the mesh network. This new multi-RAT node?210,?220, or?230?will then be included in the neighborhood list. Optionally, a test call could be sent from a computing cloud?240, from a neighboring node, or from the PSTN to the new multi-RAT node?210,?220, or?230?to ensure proper configuration. In another embodiment, additional parameters could be derived from default values from auto-optimization and sent to the Network Element Manager and Planning Tool

An alternate method of self-configuring a multi-RAT node?210,?220, or?230?is shown in?FIG. 7. When a multi-RAT node?210,220, or?230?enters a mesh network, its internal architecture detects?710?a SON module, which in this embodiment could be stored on a computing cloud?240. The new multi-RAT node?210,?220, or?230?may detect the SON server if it was located on a computing cloud?240?by making a backhaul connection with a multi-RAT node?210,?220, or?230?that is already a part of the mesh network. This multi-RAT node?210,?220, or?230?could in turn be connected to a computing cloud?240.

After this connection is established, the computing cloud?240?could sends?720?an IP address to the new multi-RAT node210,?220, or?230. The new multi-RAT node?210,?220, or?230?could then connect to the computing cloud so that the computing cloud?240?could authenticate?730?the multi-RAT node?210,?220, or?230. In an alternate embodiment, an SDN controller?810?could authenticate?730?the multi-RAT node?210,?220, or?230. Optionally, the new multi-RAT node?210,?220, or?230?could download configuration data or any additional software it may need in order to effectively participate in the mesh network from the computing cloud?240?or the SDN controller?810. In alternative embodiments, the new multi-RAT node?210,?220, or?230?could obtain additional software from other multi-RAT nodes?210,?220, or?230?within the mesh network.

The next step in this embodiment is for the new multi-RAT node?210,?220, or?230?to perform?740?Access Transport and Multipoint-to-Multipoint Backhaul configuration. One way the new node could do this is to create a connection to a neighboring multi-RAT node?210,?220, or?230, which in turn is connected to an OAM. Once this connection has been made, the neighboring multi-RAT node?210,?220, or?230, the OAM, a computing cloud?240, or an SDN controller?810?could send configuration data to the new node. This configuration data could be pre-configured information, configuration data to replace a malfunctioning node within the network, new configuration data suitable for participation within the network, and the like.

Finally, the new multi-RAT node?210,?220, or?230?establishes?750?S1-MME, S1-U and X2 links with a computing cloud. At this point, the new multi-RAT node?210,?220, or?230?is fully integrated into the mesh network. As such, the OAM, the SDN controller?810, and dependent nodes, e.g., MMEs and other multi-RAT nodes?210,?220, or?230, are notified that the new multi-RAT node?210,?220, or?230?is ready to perform the next required operation.

When a new node comes on, if there is no "wired" connection, the SON modules can instruct that node to forego turning on access radios, such as LTE access, Wi-Fi access and so forth, until the network has established a wired backhaul connection. Those skilled in the art will recognize that a wired connection could mean an actual wire connection, such as copper, a fiber optic connection, and the like, or a microwave link. Once a wired backhaul connection has been established, the SON modules will relay this information to nodes within the network so that they can activate access. In that way, the mesh network will have ensured that it has a connection to the core network.

(2) Network Optimization by Changing an Operational Parameter

With reference to?FIG. 4, alternate embodiments could comprise a computing cloud?240?instructing at least one multi-RAT node?210,?220, or?230?to receive?410?at least one environmental condition chosen from the aforementioned groups. Those of skill in the art will recognize that these environmental conditions are known to affect network performance. As such, the list we provided previously of environmental conditions at the network level, at the multi-RAT node level, and at the UE level is intended to be comprehensive without being limiting. In the embodiments of this section, the methods disclosed herein follow the steps depicted in?FIG. 4. The environmental condition and operating parameters can vary, but the method steps remain consistent.

The multi-RAT node?210,?220, or?230?may have an environmental condition already stored?415?in internal memory, or it may optionally measure?405?the environmental condition using its receiving hardware. Once it has made the determination, it could send the environmental condition to a SON module located in one embodiment in a computing cloud?240. The SON module within the computing cloud?240?could store?415?the environmental condition and then evaluate?420?the environmental condition, for example, in light of other information that it possesses regarding the current state of the network. After evaluating?420?the environmental condition, the computing cloud?240?could determine?430?whether a multi-RAT node?210,220, or?230?within the network should change an operational parameter, e.g., power level, channel, sub-channel, frequency band, sub-carrier frequency, spectrum allocation, access configuration, backhaul configuration, client, server, routing path, IP address, fully qualified domain name ("FQDN"), dynamic host configuration protocol ("DHCP") address, network provider (e.g., AT&T, Verizon, T-Mobile, and the like), participation within a heterogeneous mesh network, and the like. If the computing cloud?240?determines?430?that an operational parameter should be changed, it could instruct?435?a multi-RAT node?210,?220, or?230?within the mesh network to change an operational parameter.

In an alternate embodiment, the multi-RAT node?210,?220, or?230?within a mesh network could include a SON module for performing the aforementioned steps. The steps described above could be performed by a single multi-RAT node or by two or more nodes acting in concert. In one of these embodiments, for example, a SON module within a multi-RAT node?210,220, or?230?could include programming that instructs the multi-RAT node?210,?220, or?230?to measure?405?an environmental condition. After the node has received?410?the environmental condition in an internal processor, it could store?415?and evaluate?420?the environmental condition. After evaluating?420?the environmental condition, the SON module could determine430?whether to change an operational parameter.

Either of these embodiments could also be communicatively coupled to an SDN controller or controller.?FIG. 8?is an illustration of the architecture of this embodiment. In this embodiment, an SDN controller?810?is communicatively coupled to a SON server?820, which is part of a computing cloud?240. The computing cloud SON server?820?is in turn communicatively coupled to a heterogeneous mesh network?830?comprised of multi-RAT nodes?840?and?850.

In this embodiment, the SDN controller?810?may have information regarding quality of service, authentication, security requirements, operator policies, network polices, capacity, routing optimization, and other environmental conditions known to those skilled in the art. Based on these environmental conditions, the SDN controller?810?could instruct the SON server820?or a SON module located within multi-RAT node?840?or?850?to alter an operational parameter. The SDN controller may issue this instruction based upon an environmental condition existing within the heterogeneous mesh network?830, or based upon information it has learned form an external source, e.g., an OpenFlow enabled device.

The multi-RAT nodes?840,?850?depicted in?FIG. 8?have the same functionality, hardware, etc. as described throughout this application with respect to multi-RAT nodes?210,?220, or?230. Reference numerals are therefore interchangeable. Similarly, the embodiments described with reference to the computing cloud?240?can also be performed by the SON server?820.

In an exemplary implementation of these SON embodiments, a multi-RAT node may determine that it is approaching its capacity limit. In this embodiment, the SON module within the multi-RAT node?840?or?850?and a SON module on the SON server?820?could work together to determine if the multi-RAT node?840?or?850?should increase its capacity by reducing its output power, thereby taking advantage of spectral reuse. In this embodiment, the multi-RAT node?840?or?850?would notify the SON module in the SON server?820?that it is approaching a capacity limit. It could also request a change in operational parameter such as reduced output power.

Upon receiving this request, the SON module on the SON server?820?could, for example, evaluate radio bearer utilization, quality of service, operator policies, and capacity considerations of other nodes in the mesh network when deciding whether to grant a particular node‘s request to increase capacity by taking advantage of spectral reuse. In this embodiment, the SON module on the SON server?820?could inform other nodes within the network of the spectral reuse. The SON module on the SON server?820?may determine that there will be a coverage gap once the node reaching capacity reduces its power. In this situation, the SON module on the SON server?820?could address this coverage gap by orchestrating handoffs for any UE that would fall within a coverage gap. Alternatively, the SON module on the SON server?820?could instruct some nodes within the network to increase their power in load-balancing techniques well known within the art.

In another embodiment of the present invention, a SON module within a first multi-RAT node?840?or?850?may detect that a second neighboring multi-RAT node has ceased functioning properly. In this embodiment, the SON module within the first multi-RAT node?840?or?850?may determine that it should increase its power output to fill the coverage gap. This SON functionality could be performed exclusively at the multi-RAT node?840?or?850?level, or as a hybrid-SON implementation jointly between a multi-RAT node?840?or?850?and a SON module on a SON server?820?and/or an SDN controller?810. If this functionality is performed in conjunction with a computing cloud SON module on a SON server?820, the computing cloud?240could coordinate with the functioning multi-RAT nodes?840?or?850?so that at least one of them increases power, thereby extending coverage. After the coverage area has been extended, multi-RAT nodes?840?or?850?may update the virtualization manager with the resulting radio bearer capacity reduction information. Additionally, in this embodiment, the multi-RAT node(s)?840,?850?may have to handoff UE sessions in progress gracefully to other neighboring multi-RAT nodes in order to effectively extend coverage.

In an alternate embodiment, a SON module within a multi-RAT node?840?or?850?may contain internal logic that instructs it to change an operational parameter, such as channel, if an environmental condition such as interference falls within a certain range of values, for example. In another embodiment, the environmental condition could be signal-to-noise ratio and the operational parameter could be power level.

In another embodiment, a multi-RAT node?840?or?850?may detect an environmental condition of interference from a neighboring node. One way to mitigate this interference could be to determine the interference zone between the two adjacent nodes. This determination could, for example, be made using SON modules stored on a processor in the computing cloud?240?or?820?or in a multi-RAT node?840?or?850. After the interference zone has been determined, the SON module could calculate a new output power for the two nodes who are having interference issues such that the interference would disappear. In this SON module, the computing cloud?240?or?820?or the multi-RAT node?840?or?850?performing the interference calculation could instruct the two interfering neighboring nodes to reduce their power. In addition, the SON module could create a new configuration file for the two interfering nodes to accurately reflect the new output power levels of each.

An alternate embodiment could include a mesh network having at least two-multi-RAT nodes?210,?220, or?230?with a wired connection to a computing cloud?240. In this embodiment, a SON module within a computing cloud?240?could monitor the environmental condition of network congestion. If the SON module determined that network congestion exceeded a particular performance metric, the SON module could use information contained within the routing tables to determine if it should alter the wired backhaul link it is using to transmit data to the network based upon the routing tables and where the network congestion is occurring within the mesh network. In this embodiment, an operational parameter could be the choice of which wired backhaul link should be used.

(3) Switching Roles from Access to Backhaul

In another embodiment, a SON module could instruct a multi-RAT node?210,?220, or?230?to switch its access radio to a backhaul radio and vice-versa if for example the SON module determined?430?that it was nearing a capacity threshold. This SON module is possible because of the custom architecture discussed below with respect to?FIG. 3. An example implementation of this SON module could occur in a mesh network having a plurality of multi-RAT nodes?210,?220, or?230coupled to a computing cloud?240. One of the multi-RAT nodes?210,?220, or?230?could be using a Wi-Fi radio for access and an LTE radio for backhaul. By measuring environmental conditions?405, the multi-RAT node?210,?220, or?230?or the computing cloud?240?may determine?430?that a node is experiencing a backlog on the access side, which is an environmental condition, and that it could increase its efficiency by taking advantage of the greater downlink capacity built into the LTE standard. In this situation, the SON modules within the computing cloud?240?and the multi-RAT node?210,?220, or?230?could coordinate so that the multi-RAT node?210,?220, or?230?dynamically switches an operational parameter such as switching its access to backhaul, i.e., the LTE radio in multi-RAT node?210,?220, or?230?would be used for backhaul and the Wi-Fi radio would be used for access.

In an alternate embodiment, this SON module could reside exclusively within the multi-RAT nodes?210,?220, or?230?within the mesh network. In this embodiment, a multi-RAT node?210,?220, or?230?within the network may determine?430?that it, or one of its neighbors, is experiencing a backlog, by measuring?405?an environmental condition, receiving?410?the measurement within a processor, storing?415?the measurement, and evaluating?420?the environmental condition within the mesh network. The SON module within the multi-RAT node?210,?220, or?230?could similarly make this determination based on cached information, internal measurements, distributed intelligence, routing table information, and the like. Either way, once the SON module has determined that congestion could be alleviated if a role switch was performed, the SON module could notify the congested multi-RAT node?210,?220, or?230?to perform a role switch for the embodiment where the SON module is stored in a computing cloud?240. In the embodiment where the SON modules is stored in a multi-RAT node?210,220, or?230, the multi-RAT node?210,?220, or?230?could notify its neighbors of its intent to switch roles, and then switch roles. Alternatively, it could notify its neighbor, who is experiencing the backlog, that its neighbor should switch roles.

In yet another alternate embodiment, an SDN controller?810?could determine that the heterogeneous mesh network?830was nearing a capacity threshold. The software within the SDN controller?810?could interact with a SON module located in a multi-RAT node?840,?850?or on a SON server?820?in a computing cloud?240?to perform the role reversal described above. More specifically, after the SDN controller?810?determined that a capacity threshold was being reached, it could pass that information to a SON module within a computing cloud?240, a multi-RAT node?840,?850, or both. Once these SON modules have this environmental condition information, they could follow the steps discussed above to determine if one of the multi-RAT nodes?840,?850?should dynamically switch its access and backhaul configurations.

(4) Reallocating Underutilized Spectrum within a Network

In additional embodiments, a SON module within a computing cloud?240?could provide additional floating spectrum to one or more multi-RAT nodes?840,?850?to alter an environmental condition such as capacity, quality of service, efficient spectrum reuse, and the like. In this embodiment, multi-RAT nodes?840,?850?may have been given a certain amount of spectrum to service UE within their range. Some of that spectrum may be underutilized. If other multi-RAT nodes within the mesh network could use the underutilized spectrum, a SON module could redistribute frequency allocations to the multi-RAT nodes?840,?850. This SON module could be resident on a server?820?within a computing cloud?240?or in a multi-RAT node840,?850, or both. Additionally, the SON module could consider environmental conditions such as network capacity in deciding whether to change operational parameters such as frequency allocation when determining if it should reallocate underutilized spectrum.

In an alternate embodiment, a portion of dedicated spectrum could be allocated for common use. In this embodiment, a SON module resident on a computing cloud?240?and/or a multi-RAT node?210,?220, or?230?could oversee sharing of the common spectrum based on parameters such as network demand and current frequency allocation.

In alternate embodiments, an SDN controller?810?could initiate the reallocation of spectrum within a network based on information it receives from an external device, such as an OpenFlow enabled device. In this embodiment, it is possible that the device, e.g., the OpenFlow device could measure an environmental condition such as network capacity and determine that the heterogeneous mesh network could perform more efficiently if a SON module within the network reallocates some of the spectrum. The OpenFlow device could communicate this information to the SDN controller?810, which in turn could instruct a SON module located in either a computing cloud?240?or a multi-RAT node?840,?850?to perform the spectrum allocation described in this section.

FIGS. 9A-G?illustrate the concept of floating spectrum for the foregoing embodiments. This floating spectrum can be provisioned for access or backhaul and can be distributed among multi-RAT nodes?210,?220, or?230?within a heterogeneous mesh network. With reference to?FIG. 9A, this exemplary network is comprised of three cell sites—A, B, and C—each being serviced by a multi-RAT node?210,?220, or?230. The access frequency allocations for each site are F1, F2, and F3, respectively as shown in?FIG. 9B. Those skilled in the art will recognize that these allocations represent a spectrum of resources, e.g., frequencies in an OFDM scenario, timeslots in a TDMA scenario, and the like.

FIG. 9C?depicts the backhaul links BF1 and BF2 between adjacent cells. In one embodiment, the backhaul links could be wireless, in which case BF1 and BF2 represent backhaul resources, e.g., frequencies or timeslots. Although the cell sites are shown separate from one another, this is to illustrate the backhaul links and not intended to imply that there are coverage gaps within the network. In this embodiment, frequencies F1, F2, F3 represent access technology frequencies, e.g., LTE access.

If cell site C, having a frequency allocation of F3, expects or experiences congestion, it may request "floating" resources from a computing cloud or from one or more of its neighbors. Assuming that cell site C requested additional frequency from a computing cloud?240,?FIG. 9D?shows the computing cloud?240?replying with a floating frequency allocation F4 that may be used by site C. As can be seen in?FIG. 9E, cell site C now has additional spectrum, F3 and F4, to service its clients.

In an alternate embodiment, it is possible for subscribers to cell site C to handoff or terminate their connections in the future. In that situation, cell site C no longer requires the previously allocated floating frequency.?FIG. 9F?depicts this scenario. In?FIG. 9F, subscribers have transferred to cell site B, which now needs additional resources to handle the increased traffic. As part of the handoff procedure, cell site C could inform the computing cloud?240, or one or more of its neighbors, about the release of the floating frequency, as well as the handoff of subscribers to cell site B.

Assuming that cell site C informed a computing cloud?240?about the release of spectrum and the handoff, the computing cloud?240?could inform cell site B about the availability of floating frequency F4. In addition, the computing cloud?240?could notify cell sites B and C about an extra backhaul frequency BF3 that the two sites may use to increase throughput.?FIG. 9Gillustrates the state of the network after the spectrum has floated to cell site B. If necessary, cell site A is able to receive the allocation of floating spectrum F4 as well, in the same manner as described above.

In some embodiments, the above example is performed without the use of a centralized computing cloud?240. In these embodiments, multi-RAT nodes?210,?220, or?230?maintain a decentralized pool of available resources and determine amongst themselves how the resources are to be allocated.

(5) Coordinating Handoffs

In another embodiment, two multi-RAT nodes may be operating within close proximity to one another, but they may be servicing different customers, e.g., Verizon and AT&T. Referring to?FIG. 2, assume multi-RAT node?210?was servicing Verizon customers and multi-RAT node?220?was servicing AT&T customers. If multi-RAT node?210?reached a pre-determined capacity threshold, it could coordinate with multi-RAT node?220?to handoff some of its Verizon customers, who are operating in a different frequency band, to multi-RAT node?220. This coordination would include, for example, querying whether multi-RAT node?220?had sufficient capacity to service additional users, determining which users were within range of multi-RAT node?220?and so forth.

The SON modules within each of the multi-RAT nodes?210,?220?could orchestrate this handoff by, for example, first determining that it is advisable from a network performance standpoint, and second by executing the steps necessary to perform the handoff, including reprovisioning multi-RAT node?220?to accommodate users on a different frequency band. Multi-RAT node?220?could provide service to customers of both Verizon and AT&T on two different frequency bands. The SON modules could use an environmental condition or a plurality of environmental conditions to make this determination.

In this embodiment, once multi-RAT node?220?has been provisioned to provide services on two different frequencies, its SON module could coordinate with the SON module within multi-RAT node?210?by sharing information such as, traffic details, call details, RF quality measurements, and so forth. These nodes?210?and?220, which could be two or could be many, can add or remove frequency bands and can coordinate with each other to force user equipment handoffs to accommodate the change in the frequency scheme.

In an alternate embodiment, the computing cloud?240?could reallocate provider-specific resources to service another provider‘s customers. In this embodiment, the computing cloud?240?could have received?410?an environmental condition indicating that multi-RAT node?210?was nearing a capacity threshold. The computing cloud could then store?415?and evaluate?420?the environmental condition. If the computing cloud?240?determined?430?that an operational parameter, such as frequency, should be adjusted, it could instruct multi-RAT node?220?alter an operational parameter as described above.

(6) White-Space Frequencies

An alternate embodiment of the present invention could include a mesh network wherein at least one multi-RAT node?210,220, or?230?operates over a white space frequency. As those of skill in the art will recognize, using white-space frequencies for communication requires flexibility in terms of pre-selecting or dynamically-selecting an operational frequency because these frequency bands are unlicensed. The white space frequency bands are, therefore, shared among many users.

In this embodiment, SON modules within multi-RAT nodes?210,?220, or?230?could use spectrum sensing techniques to measure?405?environmental conditions, such as the availability of unlicensed spectrum. If after receiving?410?and storing?415the environmental condition, the SON module determines?430?that an operational parameter, e.g., available frequency, should be adjusted, it can perform the necessary provisioning within the multi-RAT node?210,?220, or?230?to enable operation over a white space frequency. In an alternate embodiment, a SON module within a multi-RAT node?210,?220, or230?could query a database containing frequency availability based on location, time, and the like to determine?430?an available frequency band. This database could be stored within any or all of the multi-RAT nodes?210,?220, or?230?in a particular mesh network, in a computing cloud?240, on an SDN controller?810, or in a remote location. In additional embodiments, different nodes within a mesh network could use different TV white space frequencies to minimize the potential of interference. In this embodiment, the SON module that orchestrates frequency allocation for the multi-RAT nodes?210,?220, or?230?could be located in a computing cloud?240.

(7) Utilizing Frequency Bands with Limitations

In this embodiment, a SON module, resident on either a multi-RAT node?210,?220, or?230?or within a computing could?240, or both, could enable using a frequency band where the FCC has placed power limitations upon sub-carrier frequencies or sub-channels. These guard bands protect neighboring transmitters/receivers from interference. A typical guard band will prohibit high power transmission on the edge of cells upon which there may be interference. These guard bands may prohibit UEs from operating on channels near the edges of the allocated frequency band for a particular cell when that UE approaches the edge of the coverage zone for the cell. UEs located close to the edge of a coverage zone where frequency limitations are in place may be able to transmit on channels within the middle of the allocated frequency band without interfering with neighboring cells.

This SON module, depicted in?FIG. 10, could include a configuration profile, which provides details regarding frequency limitations of a given band. Once the configuration profile is enabled, meaning SON modules within the multi-RAT nodes210,?220, or?230?and/or computing cloud?240?are aware that there are frequency limitations existing somewhere within the network‘s coverage area, multi-RAT nodes?210,?220, or?230?could monitor?1010?the location and/or signal strength of at least one UE.

The multi-RAT nodes?210,?220, or?230?within this network could scan the network to measure environmental conditions indicative of the neighborhood profile and interference patterns. This information could be reported to other multi-RAT nodes210,?220, or?230?within the network, to a computing cloud?240?or to an SDN controller?810. In this embodiment, a central SON module located on a computing cloud?240?could inform individual multi-RAT nodes?210,?220, or?230?about their neighbor‘s cell interference patterns, as well as provide an acceptable frequency usage pattern. In alternate embodiments, a SON module located on a multi-RAT node?210,?220, or?230?could inform other nodes within the network about their neighbor‘s cell interference patterns, as well as provide an acceptable frequency usage pattern. Multi-RAT nodes?210,?220, or?230?can use direction/speed knowledge to anticipate future locations of the UE and pre-calculate future frequency requirements.

A SON module within a multi-RAT node?210,?220, or?230?can determine?1020?that a UE is approaching an area that is restricted in terms of its sub-frequency, sub-channel, channel, and the like. The SON module could make this determination1020?by monitoring the UE‘s signal strength, its geo-location readings, and the like. Once the UE has entered an area that is restricted, the SON module could use information it knows about the frequency restrictions, which could optionally be stored in a configuration profile, to determine?1030?an appropriate change for an operational parameter, e.g., channel, sub-channel, sub-frequency carrier, and the like. The SON module could also notify?1040?the UE that it should change an operational parameter to accommodate the restrictive frequencies. Once the UE has moved outside of the restricted frequency zone, it could be handed off to a different frequency.

If a SON module within a computing cloud?240?was overseeing adherence to frequency band limitations of this embodiment, it could receive information regarding environmental conditions form multi-RAT nodes?210,?220, or?230?within the mesh network servicing the various UEs. It could store?415?this information in a processor and use this information to determine430?if one of the multi-RAT nodes?210,?220, or?230?should change an operational parameter in order to continue to comply with the limitations placed upon the frequency band.

(8) Small Cell Connection

Another embodiment of the present invention could use direction/speed knowledge from a UE in a SON module designed to reconcile whether to connect to a small cell or stay connected to a macro cell. According to recent news, AT&T is planning to combine 3G, 4G, LTE and Wi-Fi access in its radio access small cells and to deploy 40,000 or more of the tin base stations through 2015. While the addition of small cells adds voice capacity and enhanced data access, it also creates challenges when, for example, a "small cell battles the network for a device that is attempting to connect to the network . . . . For instance, if a user is in their car connected to the macro network, AT&T does not want that user roaming onto a small cell located in a restaurant on the street as they pull up at a stop light and then losing the connection as they drive away. "3G, 4G & Wi-Fi: AT&T Plans Small-Cell Threesome,"?Light Reading Mobile; May 9, 2013; www.lightreading.com/at-t/3g-4g--wifi-att-plans-smallcell-threesome/240154556. AT&T further noted that reconciling the choice between a small cell and a macro network is "exponentially more difficult when layering together and managing 3G, 4G, and Wi-Fi connections." Id. (emphasis in original).

In this embodiment, the difficultly of layering together and managing disparate network connections, such as 3G, 4G, and Wi-Fi is addressed by the abstraction layer?340?of the present invention, which creates network agnostic data, coupled with SON intelligence.?FIG. 11?is illustrative for describing the functionality of this SON module. The SON module of this embodiment could be used when a UE?1110?could connect to both a macro network?1120?and a small cell network?1130. The macro network?1120?could be serviced by any base station, or it could be serviced by multi-RAT nodes. In this example, and without limiting the scope of the claims, we assume that the macro network?1120?is being serviced by a base station?1125.

Suppose that a UE?1110?was travelling in a car just prior to reaching an intersection?1140. The UE?1110?may have been receiving service from a base station?1125?that is part of a macro network before it reached the intersection. During the time that the UE?1110?is idle at the intersection, however, it may connect with a multi-RAT node?1132, which has the same functionality and architecture as multi-RAT nodes?210,?220,?230,?840?and?850, within a small cell mesh network?1130. This small cell mesh network?1130, for example, could be installed within a mall.

One of the environmental conditions that the UE?1110?could be measuring is signal strength from the base station?1125. If the signal strength from the small cell multi-RAT node?1134, which has the same functionality and architecture as multi-RAT nodes?210,?220,?230,?840,?850, and?1132, was stronger than that from the macro cell base station?1125?while the UE?1110was at the intersection?1140, the UE‘s?1110?internal logic would automatically begin determining if it should handoff to the small cell?1130, or remain connected to the macro cell?1120.

Specifically, in this embodiment, the steps of which are depicted in?FIG. 12, when the UE?1110?comes within range of multi-RAT node?1132, multi-RAT node?1132?would receive?1210?a signal from the UE indicating that the UE?1110?is within its range. In order to determine whether multi-RAT node?1132?should orchestrate a handover from base station?1125, it could obtain?1220?heuristic information from the UE?1110. The heuristic information could be: a distance traveled over a time T1, an average speed over a time T2, a destination stored in internal memory within the UE?1110, a speed limit measurement for a nearby road, a possible direction in which the UE?1110?could travel, a signal strength measurement for a servicing base station?1125, and a signal strength measurement for a multi-RAT node?1132,?1134, or?1136, which has the same functionality and architecture as multi-RAT nodes?210,?220,?230,?840?850,?1132, and?1134. The times T1 and T2 could vary and do not have to be equal.

At this point, the multi-RAT node?1132?could use one or more of these heuristic data to determine whether the UE?1110should remain connected to base station?1125?or should handover to multi-RAT node?1132?or either of the other multi-RAT nodes?1134?or?1136?in the mall. A SON module stored in a processor for example could create?1230?a position profile from the heuristics. After creating?1230?a position profile, the method of this embodiment could store?1240?the position profile in internal memory within the multi-RAT node?1132?before evaluating?1250?the position profile in order to predict?1260?a future location or trajectory for the UE?1110. Once the SON module predicts?1260?a future location for the UE?1110, it can determine?1270?whether the UE should handover to multi-RAT node?1132,?1134, or?1136.

Using the position profile and optionally present metrics, the SON module could determine if it has enough information to predict?1260?a statistically sound, future location of the UE?1110?in the upcoming minutes once the UE?1110?begins moving again. While evaluating?1250, the SON module may, for example, use information regarding a final destination loaded into map navigation software to predict?1260?the future location of the UE?1110. If for example, the UE‘s?1110?map navigation software has the mall as its final destination, the SON module could weight its prediction accordingly. On the other hand, if the final destination is elsewhere, the SON module could use predictive models to account for the fact that the UE‘s?1110owner may spontaneously stop at the mall in determining?1270?whether to create a connection between the UE?1110?and the small cell mesh network?1130. If the SON module predicts?1260?that the UE?1110?is going to continue driving northbound on the road shown in?FIG. 11, it could instruct the UE?1110?to maintain its connection with the macro network1120. If, however, the SON module predicts?1260?that the UE?1110?is instead going to be headed to the mall, it could instruct the UE?1110?and/or one of the multi-RAT nodes?1132,?1134,?1136?within the small cell mesh network?1130?to create a connection so that the UE?1110?can join the small cell mesh network.

Alternatively, the SON module may determine that it does not have enough information to predict?1260, within an acceptable range of accuracy, the future location of the UE?1110. In this instance, the small cell mesh network?1130?could continue to monitor the speed, direction, and or position of the UE?1110?for a short amount of time to enhance the accuracy of its predictive modeling. The SON module could use measurements of environmental conditions obtained after the UE?1110begins moving away from the intersection?1140?to create heuristics that enhance its future prediction.

Assume UE?1110?was connected to multi-RAT node?1132?and that the SON module within multi-RAT node?1132?followed the steps depicted in?FIG. 12?in order to determine whether the UE?1110?should remain connected to the macro network1120?or should instead connect to the small cell mesh network?1130. If multi-RAT node?1132?was unable to make a statistically sound decision regarding the likely future position of the UE?1110, it could initiate a handoff of the UE?1110?to multi-RAT node?1134. The advantage of this handoff would be, once the UE?1110?began moving, multi-RAT node?1134could maintain a stronger connection with it for a further distance. This would enable multi-RAT node?1134?to obtain additional current position/speed/direction information from the UE?1110. Similarly, multi-RAT node?1134?could facilitate a handoff to multi-RAT node?1136?so that additional position, direction, or speed information could be obtained.

Turning again to?FIG. 12, at some point, a SON module will determine?1270?if the UE?1110?should remain connected to the macro network?1120?or connect to a multi-RAT node?1132,?1134, or?1136?within the small cell mesh network?1130?In the event that the SON module is unable to obtain enough information from the UE?1110?to determine?1270?which network is optimal, the default recommendation could be that the UE?1110?remain connected to the macro network?1120.

(9) Client-Server Authentication

This SON embodiment takes resources that already exist in a client-server scenario and uses those resources to allow a device to create a peer-to-peer relationship with an operating multi-RAT node?210,?220, or?230. In today‘s technology, assuming that a user desires to implement a meshed network of base stations, when a new base station enters that mesh network, it must authenticate its credentials using a peer-to-peer protocol. This type of authentication also occurs when user equipment joins a meshed network.

The difference in the protocols used under these two scenarios is, when user equipment enters a mesh network, it is joining in a master-slave or client-server scenario. This authentication is common place and cost effective from a network resources standpoint. When a base station, however, wishes to join a network, it must use peer-to-peer authentication, which is more costly from a resources standpoint. As such, it is desirable for a mesh network of base stations to be able to add base stations to the mesh network using client-server authentication procedures

This embodiment uses a SON module to allow multi-RAT nodes?210,?220, or?230?to be added to a mesh network using a client-server authentication. In current deployments the role of networking resources on a multi-RAT node?210,?220, or?230is statically defined for all practical purposes. Despite these static roles, it is physically possible for an Ethernet or Wi-Fi interface to be provisioned as backhaul. Similarly, a Wi-Fi interface can be used for access.

In this embodiment, a mesh network could be managed by a computing cloud?240. When a new multi-RAT node?210,?220, or?230?wishes to join the mesh network, it would have to establish a connection with the computing cloud?240?because the computing cloud?240?is managing the network. As a precursor for creating that connection, the new multi-RAT node?210,220, or?230?would have to be authenticated.?FIG. 13?illustrates a network configuration that could employ this SON embodiment.

In this embodiment, each of the multi-RAT nodes?1310,?1320, and?1330?have a SON module stored in a processor that enables the steps described herein. These multi-RAT nodes have the same functionality and architecture as described throughout this application for multi-RAT nodes with different reference numerals. Additionally, the computing cloud?1340also has a SON module that allows it to perform its role in the steps herein described. Assume that multi-RAT nodes?1310and?1320?are participating in a mesh network?1350. The computing cloud?1340?is managing some of the functionality of that mesh network?1350. In the event that multi-RAT node?1330?wishes to join the mesh network?1350?it could begin that process by transmitting information sufficient for either of the other multi-RAT nodes?1310?and?1320?to identify multi-RAT node?1330?as a multi-RAT node.

Upon receiving?410?multi-RAT node?1330‘s transmission, multi-RAT node?1220?could store?415?the environmental condition, i.e., an authentication request, evaluate?420?the request, and determine?430?that it will establish a client-server relationship with multi-RAT node?1330. Multi-RAT node?1320?could then connect to the computing cloud?1340?via a secure connection, for example a VPN connection.

Once multi-RAT node?1330?has a connection to the computing cloud?1340?through multi-RAT node?1320, it could notify the computing cloud?1340?that it would like to establish an independent connection with the computing cloud?1340. The computing cloud?1340?could then authenticate multi-RAT node?1330, thereby freeing up the resources of the multi-RAT nodes in the mesh network?1350. In this embodiment, after the computing cloud?1340?has authenticated multi-RAT node1330, it could instruct multi-RAT nodes?1310?and?1320?about the steps they should take to add multi-RAT node?1330?to the mesh network?1330.

(10) Solving the "Hidden Node" Problem

In Wi-Fi communication networks, there is a design challenge called the "hidden node problem." In a Wi-Fi network, when an access point is transmitting, all of the nodes within its range can hear the transmission. This set-up has its benefits because when other nodes hear someone within the network transmitting, they do not transmit. When nodes do not hear another broadcast, they use that opportunity to transmit any information that may be in their queue to transmit. This same hidden node problem can occur in other wireless communication networks as well.

FIG. 14A?shows the "hidden node" problem, while?FIG. 14B?shows a SON solution for overcoming the problem. In this embodiment, the "hidden node" problem could be an environmental condition.

FIG. 14A?shows a small communication network containing three Wi-Fi nodes?1410,?1420, and?1430. In this communication network, node?1420?is within the communication range of both node?1410?and node?1430. Nodes?1410?and?1430, however, are out of range of each other. In other words, node?1410?is hidden from node?1430‘s perspective, and vice versa. This is the "hidden node" problem. It is a problem because, if node?1410?begins broadcasting, node?1420?will hear the broadcast, while node?1430?will not hear the broadcast. From node?1430‘s perspective, the network is idle, which means that node1430?can begin transmitting. If the transmissions from node?1410?and node?1430?overlap in time, node?1420?will not be able to receive any information from either node during the time in which their transmissions overlap. This will result in lost data, which is undesirable. This problem becomes much more insidious when the mesh network becomes larger.

In the SON embodiments of this invention, the hidden node problem can be overcome by sharing intelligence about the nodes within a particular network. In one embodiment, shown in?FIG. 14B, the network could be comprised of three multi-RAT nodes?1440,?1450,?1460, and a computing cloud?1470?having a SON module. In this embodiment, each of the multi-RAT nodes?1440,?1450, and?1460?would send environmental conditions sufficient to identify its in-range neighbors. By way of example, multi-RAT node?1440?could report that it sees multi-RAT node?1450. Multi-RAT node?1450?could report that it sees multi-RAT nodes?1440?and?1460. And multi-RAT node?1460?could report that it sees multi-RAT node?1450. After receiving?410?these environmental conditions, the SON module within the computing cloud?1470?could store?415?and evaluate?420?the environmental conditions. The SON module in the computing cloud?1470?could then determine?430?that there was a hidden node problem and that an operational parameter should be changed?435.

In order to overcome the hidden node problem, the SON module in the computing cloud?1470?could coordinate changing?435an operational parameter, such as transmission channel, by instructing one of the multi-RAT nodes?1440?or?1460?to change its channel. Alternatively, the SON module could alter routing tables by pruning routes or prioritizing routes. In an alternate embodiment, this SON module could be performed by multi-RAT nodes?1440,?1450, or?1460?within a mesh network by using distributed intelligence techniques to compile a joint list of who sees whom within the network. Once a "hidden node" problem is discovered, the SON module within the multi-RAT nodes?1440,?1450, or?1460?could have a set of default operational parameters, such as changing a channel, which could be performed.

SRC=https://www.google.com.hk/patents/US20140126410

Heterogeneous Self-Organizing Network for Access and Backhaul