Research Methods on Development and Validation of Ad Hoc and Wireless Sensor Networks (WSNs) (Bachelor thesis)
Kritsis, Kosmas
The verification of theoretical analysis is a vital step to the development of an application or a protocol for wireless networks. Most of proposals are evaluated through mathematical analysis followed by either simulation or experimental validation campaigns. Up to this point, we provide a detailed description of the development process and limitations of Wireless Sensor Networks (WSNs) as well as analyze a large set of statistics on articles published (i.e. 674 papers in total) in Ad-Hoc and WSN related top representative conferences over the period 2008-2013 (i.e. ACM/IEEE IPSN, ACM MobiCom, ACM MobiHoc and ACM SenSys). We mainly focus on the evaluation methodologies provided by researchers. More specifically, our goal is to explore the role of simulators and testbeds in the theoretical analysis of a scenario throughout the application development procedure. We show that there is a tendency that more and more researchers rely on custom or open testbeds in order to evaluate the performance of their proposals. Simulators indeed fail to reproduce actual environment conditions of the deployed systems. Experimentation with real hardware allows our research community to mind the gaps between simulation and real deployment. Still, as experimental approach through custom testbeds comprises a low reproducibility level (i.e., 16.5%), we investigate to what extent such performance evaluation methods will be able to bridge those gaps. We finally discuss experimental testbeds and their potential to replace simulators as the cornerstone of performance evaluation procedures.
| Institution and School/Department of submitter: | Σχολή Τεχνολογικών Εφαρμογών/ Τμήμα Μηχανικών Πληροφορικής |
| Subject classification: | Ad hoc networks (Computer networks) Wireless sensor networks Ad hoc δίκτυα Ασύρματα δίκτυα αισθητήρων |
| Keywords: | WSNs;Research methods;Μέθοδοι έρευνας;Wireless Sensor Networks;Δίκτυα ασύρματων αισθητήρων |
| Description: | Πτυχιακή εργασία--Σχολή Τεχνολογικών Εφαρμογών--Τμήμα Μηχανικών Πληροφορικής,2015--7007 |
| URI: | http://195.251.240.227/jspui/handle/123456789/12858 |
| Item type: | bachelorThesis |
| General Description / Additional Comments: | Πτυχιακή |
| Subject classification: | Ad hoc networks (Computer networks) Wireless sensor networks Ad hoc δίκτυα Ασύρματα δίκτυα αισθητήρων |
| Item language: | en |
| Item access scheme: | account |
| Institution and School/Department of submitter: | Σχολή Τεχνολογικών Εφαρμογών/ Τμήμα Μηχανικών Πληροφορικής |
| Publication date: | 2015-07-08 |
| Bibliographic citation: | <<Kosmas Kritsis>>, <<Research Methods on Development and Validation of Ad Hoc and Wireless Sensor Networks (WSNs)>>, <<Σχολή Τεχνολογικών Εφαρμογών/ Τμήμα Μηχανικών Πληροφορικής>>, <<Τ.Ε.Ι. Θεσσαλονίκης>>, <<2015>> |
| Abstract: | The verification of theoretical analysis is a vital step to the development of an application or a protocol for wireless networks. Most of proposals are evaluated through mathematical analysis followed by either simulation or experimental validation campaigns. Up to this point, we provide a detailed description of the development process and limitations of Wireless Sensor Networks (WSNs) as well as analyze a large set of statistics on articles published (i.e. 674 papers in total) in Ad-Hoc and WSN related top representative conferences over the period 2008-2013 (i.e. ACM/IEEE IPSN, ACM MobiCom, ACM MobiHoc and ACM SenSys). We mainly focus on the evaluation methodologies provided by researchers. More specifically, our goal is to explore the role of simulators and testbeds in the theoretical analysis of a scenario throughout the application development procedure. We show that there is a tendency that more and more researchers rely on custom or open testbeds in order to evaluate the performance of their proposals. Simulators indeed fail to reproduce actual environment conditions of the deployed systems. Experimentation with real hardware allows our research community to mind the gaps between simulation and real deployment. Still, as experimental approach through custom testbeds comprises a low reproducibility level (i.e., 16.5%), we investigate to what extent such performance evaluation methods will be able to bridge those gaps. We finally discuss experimental testbeds and their potential to replace simulators as the cornerstone of performance evaluation procedures. |
| Table of contents: | Table of Contents Abstract.........................................................................................................vii Acknowledgments.........................................................................................ix 1. Introduction.................................................................................................1 1.1 Motivation and Outline ....................................................................................1 1.2 Computer Networking......................................................................................1 1.3 Wireless Communications ..............................................................................3 1.4 Ad-Hoc Networks and WSNs: Similarities and Differences .........................4 2. Research Process in WSNs.......................................................................6 2.1 Theory – Analysis ............................................................................................7 2.1.1 Main Requirements .....................................................................................9 2.1.2 Network Requirements..............................................................................11 2.1.3 Service Requirements...............................................................................12 2.1.4 Software and Hardware Requirements .....................................................12 2.2 Design – Development...................................................................................12 2.2.1 Network Designing Procedure ..................................................................13 2.2.2 WSN Protocol Stack and Application Designing .......................................16 2.2.3 Development Procedures..........................................................................20 2.3 Performance Evaluation – Validation...........................................................21 2.3.1 Simulation-Emulation ................................................................................22 2.3.2 Testbeds ...................................................................................................23 2.4 Real Deployment – Maintenance ..................................................................23 2.4.1 Pre-deployment and Deployment Phase ..................................................23 2.4.2 Post-deployment Phase ............................................................................24 2.4.3 Re-deployment Phase of Additional Nodes ..............................................24 3. Simulators.................................................................................................25 3.1 Simulator Design Requirements...................................................................25 xii 3.2 Discrete Time Simulations ............................................................................27 3.3 Simulation Models .........................................................................................29 3.3.1 Network Model ..........................................................................................30 3.3.2 Node Model...............................................................................................33 3.4 Simulation Design..........................................................................................34 3.4.1 Abstraction Level Design ..........................................................................34 3.4.2 Processing Level Design...........................................................................35 3.5 Taxonomy of Simulators ...............................................................................36 3.6 Survey of WSN Simulators............................................................................39 3.6.1 Network Simulator 2 (NS-2) ......................................................................43 3.6.2 Network Simulator 3 (NS-3) ......................................................................44 3.6.3 OMNET++ .................................................................................................45 3.6.4 GloMoSim .................................................................................................47 3.6.5 Qualnet......................................................................................................48 3.6.6 TOSSIM ....................................................................................................49 3.6.7 COOJA......................................................................................................50 3.6.8 MSPSim ....................................................................................................52 3.6.9 Avrora........................................................................................................53 3.6.10 Matlab .....................................................................................................54 3.6.11 EnergyPlus..............................................................................................56 4. Testbeds....................................................................................................58 4.1 Testbed Requirements ..................................................................................58 4.1.1 Experimentation Requirements.................................................................59 4.1.2 Hardware Requirements ...........................................................................60 4.1.3 Mobility Features.......................................................................................62 4.1.4 Maintenance..............................................................................................63 4.2 Testbed Architectures ...................................................................................63 4.2.1 Objective-Based Classification..................................................................63 4.2.2 Structure-Based Classification ..................................................................65 4.3 Survey of WSN Hardware Motes...................................................................73 4.3.1 TelosB .......................................................................................................74 xiii 4.3.2 Tmote Sky .................................................................................................75 4.3.3 MICA2 .......................................................................................................75 4.3.4 MICAz .......................................................................................................75 4.3.5 USRP ........................................................................................................76 4.3.6 WARP .......................................................................................................76 4.3.7 iMote .........................................................................................................77 4.3.8 IMote2 .......................................................................................................77 4.3.9 ZigBee-based Motes .................................................................................78 4.3.10 IRIS .........................................................................................................78 4.3.11 EPIC........................................................................................................79 4.3.12 FireFly .....................................................................................................79 4.3.13 Fleck........................................................................................................80 4.3.14 TinyNode.................................................................................................80 4.4 Survey of WSN Tesbeds................................................................................80 4.4.1 MoteLab ....................................................................................................82 4.4.2 TWIST .......................................................................................................83 4.4.3 Indriya .......................................................................................................83 4.4.4 Intel Mirage ...............................................................................................84 4.4.5 UMass DieselNet ......................................................................................84 4.4.6 Emulab ......................................................................................................85 4.4.7 WARPLab .................................................................................................86 4.4.8 FLOCKLAB ...............................................................................................86 4.4.9 ORBIT .......................................................................................................87 4.4.10 Tutornet...................................................................................................87 4.4.11 MAP ........................................................................................................88 4.4.12 NetEye ....................................................................................................88 4.4.13 KANSEI ...................................................................................................88 5. Research ...................................................................................................90 5.1 Performance Evaluation Procedures ...........................................................91 5.1.1 Simulating protocols or experimenting algorithms ....................................91 5.1.2 A Thorough Literature Study .....................................................................92 xiv 5.2 Results Of Analysis .......................................................................................96 5.2.1 Evaluation procedures ..............................................................................96 5.2.2 Reproducibility.........................................................................................101 6. Conclusions & further discussions......................................................103 6.1 Conclusions..................................................................................................103 6.2 Further discussions.....................................................................................104 6.2.1 Scientific results or proofs of concepts?..................................................104 6.2.2 Applications.............................................................................................106 6.2.3 Mobility ....................................................................................................107 Bibliography................................................................................................108 List of Figures.............................................................................................126 List of Tables ..............................................................................................128 Abbreviations..............................................................................................129 |
| Advisor name: | Chatzimisios, Periklis |
| Examining committee: | Gallais, Antoine |
| Publishing department/division: | Σχολή Τεχνολογικών Εφαρμογών/ Τμήμα Μηχανικών Πληροφορικής |
| Publishing institution: | teithe |
| Number of pages: | 144 |
| Appears in Collections: | Πτυχιακές Εργασίες |
Files in This Item:
There are no files associated with this item.
Please use this identifier to cite or link to this item:
This item is a favorite for 0 people.
http://195.251.240.227/jspui/handle/123456789/12858
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.
