<?xml version="1.0" encoding="utf-8" standalone="yes" ?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom">
  <channel>
    <title>benchmarking on DASYA</title>
    <link>https://dasya.itu.dk/tags/benchmarking/</link>
    <description>Recent content in benchmarking on DASYA</description>
    <generator>Hugo -- gohugo.io</generator>
    <language>en-us</language>
    <copyright>© DASYA, IT University of Copenhagen</copyright>
    <lastBuildDate>Tue, 15 Jul 2025 00:00:00 +0000</lastBuildDate>
    
	<atom:link href="https://dasya.itu.dk/tags/benchmarking/index.xml" rel="self" type="application/rss+xml" />
    
    
    <item>
      <title>Benchmarking Edge Devices for Data-Intensive Applications</title>
      <link>https://dasya.itu.dk/for-students/proposals/archive/pito-edge-benchmarking/</link>
      <pubDate>Tue, 15 Jul 2025 00:00:00 +0000</pubDate>
      
      <guid>https://dasya.itu.dk/for-students/proposals/archive/pito-edge-benchmarking/</guid>
      <description>The work on running data-intensive applications on very powerful, expensive, and power-hungry server hardware is very popular thanks to the growing size of data centers and high-performance computing (HPC) platforms. However, with the rise of new generation internet of things (IoT) applications, the lower-power and lower-budget hardware devices that specifically target IoT, the edge platforms, embedded devices, etc. have also become quite powerful today offering non-negligible data processing capability. For example, NVIDIA Jetsons and Coral devices allow GPU- and TPU-acceleration of AI applications at the edge and come with hardware resources that can match the resources of a laptop.</description>
    </item>
    
    <item>
      <title>Framework for Systematic Performance Experiments for Machine Learning</title>
      <link>https://dasya.itu.dk/for-students/proposals/archive/pito-radt/</link>
      <pubDate>Tue, 15 Jul 2025 00:00:00 +0000</pubDate>
      
      <guid>https://dasya.itu.dk/for-students/proposals/archive/pito-radt/</guid>
      <description>Observing how well machine learning systems utilize hardware resources is a crucial preliminary step to improve system performance and reduce hardware waste. To do such observations, one has to collect a lot of monitoring data on hardware behavior through experiments. In our group, we have recently built a framework to aid the management of such monitoring data efficiently, called Resource-Aware Data Systems Tracker. There is a variety of work to be done on this framework to improve it.</description>
    </item>
    
    <item>
      <title>Deconstructed Cloud Databases: Atomic Counters</title>
      <link>https://dasya.itu.dk/for-students/proposals/archive/mh-deconstr-counters/</link>
      <pubDate>Sat, 01 Feb 2025 00:00:00 +0000</pubDate>
      
      <guid>https://dasya.itu.dk/for-students/proposals/archive/mh-deconstr-counters/</guid>
      <description>The Deconstructed Cloud Databases project stems from a simple question: What are the minimum components required to build a data management system in the cloud? Our motivation for this project is based on the idea that reducing a system to its minimum set of components makes it easier to build, test, and maintain cloud data management systems. This approach requires less engineering effort, reduces the cost of software development, and lowers the risk of errors by minimizing the number of components that need to be managed.</description>
    </item>
    
    <item>
      <title>Benchmarking Edge Devices for Data-Intensive Applications</title>
      <link>https://dasya.itu.dk/for-students/proposals/archive/pito-edge-characterization/</link>
      <pubDate>Tue, 13 Aug 2024 00:00:00 +0000</pubDate>
      
      <guid>https://dasya.itu.dk/for-students/proposals/archive/pito-edge-characterization/</guid>
      <description>The work on running data-intensive applications on very powerful, expensive, and power-hungry server hardware is very popular thanks to the growing size of data centers and high-performance computing (HPC) platforms. However, with the rise of new generation internet of things (IoT) applications, the lower-power and lower-budget hardware devices that specifically target IoT, the edge platforms, embedded devices, etc. have also become quite powerful today offering non-negligible data processing capability. For example, NVIDIA Jetsons and Coral devices allow GPU- and TPU-acceleration of AI applications at the edge and come with hardware resources that can match the resources of a laptop.</description>
    </item>
    
    <item>
      <title>Managing Experimental Data with DuckDB</title>
      <link>https://dasya.itu.dk/for-students/proposals/archive/pito-radtduckdb/</link>
      <pubDate>Thu, 23 Nov 2023 00:00:00 +0000</pubDate>
      
      <guid>https://dasya.itu.dk/for-students/proposals/archive/pito-radtduckdb/</guid>
      <description>Observing how well data-intensive systems utilize hardware resources is a crucial preliminary step to improve system performance and reduce hardware waste. To do such observations, one has to collect a lot of monitoring data on hardware behavior through experiments. In our group, we have recently built a framework to aid the management of such monitoring data efficiently, called Resource-Aware Data Systems Tracker. Currently, this framework uses Postgres data management system to keep the experimental data.</description>
    </item>
    
    <item>
      <title>Studying Collocation for Machine Learning </title>
      <link>https://dasya.itu.dk/for-students/proposals/archive/mlcollocation/</link>
      <pubDate>Mon, 01 Aug 2022 00:00:00 +0000</pubDate>
      
      <guid>https://dasya.itu.dk/for-students/proposals/archive/mlcollocation/</guid>
      <description>State-of-the-art machine learning models are known to be compute- and power-hungry. On the other hand, modern servers come equipped with really powerful CPU-GPU co-processors. Not all machine learning models are able to use all the available hardware resources on such servers.
Workload collocation is a mechanism to increase hardware utilization when a single workload is not able to utilize all the resources on its own. While workload collocation has been heavily studied for traditional data-intensive applications such as relational databases or Spark, it has been largely unexplored for machine learning.</description>
    </item>
    
    <item>
      <title>Hardware Utilization Estimation with Machine Learning</title>
      <link>https://dasya.itu.dk/for-students/proposals/archive/mlforhwutilestimation/</link>
      <pubDate>Sun, 01 May 2022 00:00:00 +0000</pubDate>
      
      <guid>https://dasya.itu.dk/for-students/proposals/archive/mlforhwutilestimation/</guid>
      <description>Today, there are many compute- and memory-hungry data-intensive workloads from big data analytics applications to deep learning. These workloads increasingly run on shared hardware resources, which requires building hardware resource managers that can both serve the needs of workloads and utilize hardware well. Predicting the resource utilization of applications can aid such resource managers while making scheduling decisions for those applications. In this project, we aim to investigate the effectiveness of different deep learning techniques for predicting hardware resource needs of applications.</description>
    </item>
    
    <item>
      <title>Analysis of NVMe SSDs and the IO stack</title>
      <link>https://dasya.itu.dk/for-students/proposals/archive/ssdcharacterizationnew/</link>
      <pubDate>Tue, 20 Apr 2021 00:00:00 +0000</pubDate>
      
      <guid>https://dasya.itu.dk/for-students/proposals/archive/ssdcharacterizationnew/</guid>
      <description>NVMe SSDs are not a uniform class of devices. IO software stack is not uniform either. Understanding the performance characteristics of new-generation SSDs and the impact of the IO stack on their performance is crucial while determining how to design data-intensive systems. In this project, we would like to characterize the performance of a range of NVMe SSDs (e.g., Samsung Z-SSD, Intel Optane, etc.) using different libraries for submitting IOs (e.</description>
    </item>
    
    <item>
      <title>Benchmarking ARM-based storage controllers for disaggregated storage</title>
      <link>https://dasya.itu.dk/for-students/proposals/archive/armbenchmark/</link>
      <pubDate>Tue, 20 Apr 2021 00:00:00 +0000</pubDate>
      
      <guid>https://dasya.itu.dk/for-students/proposals/archive/armbenchmark/</guid>
      <description>Disaggregated storage has gained acceptance in data centers. With disaggregated storage, storage resources are decoupled from compute resources, and made available through fabric. We are particularly interested in storage resources composed of an ARM-based smartNIC, which acts as fabric target as well as storage controller for a collection of SSDs.
The performance characteristics of the storage stack are well understood on x86, but not on ARMv8. The goal of this project (research + MSc) is to (i) compile and run various forms of storage stack on ARM cores, (ii) make the storage stacks available through fabric (at present, SPDK does not run on ARM) and (iii) benchmark these storage stacks to identify bottlenecks and potential for hardware acceleration.</description>
    </item>
    
    <item>
      <title>Workload Characterization for Machine Learning</title>
      <link>https://dasya.itu.dk/for-students/proposals/archive/workloadcharacterization/</link>
      <pubDate>Tue, 20 Apr 2021 00:00:00 +0000</pubDate>
      
      <guid>https://dasya.itu.dk/for-students/proposals/archive/workloadcharacterization/</guid>
      <description>A data science infrastructure orchestrates the execution of widely used machine learning frameworks (e.g., TensorFlow , PyTorch) on a heterogeneous set of processing units (e.g., CPU, GPU, TPU, FPGA) while powering an increasingly diverse and complex range of applications (e.g., fraud detection, healthcare, virtual assistance, automatic driving). Understanding the resource consumption characteristics of different data science workloads is a necessary step before designing effective hardware resource management in any data science infrastructure.</description>
    </item>
    
    <item>
      <title>Finding Bottlenecks at Scale in Consensus Algorithms</title>
      <link>https://dasya.itu.dk/for-students/proposals/archive/consensus/</link>
      <pubDate>Mon, 14 Dec 2020 00:00:00 +0000</pubDate>
      
      <guid>https://dasya.itu.dk/for-students/proposals/archive/consensus/</guid>
      <description>Consensus mechanisms for ensuring consistency are some of the most expensive operations in managing large amounts of data. Often, there is a trade off that involves reducing the coordination overhead at the price of accepting possible data loss or inconsistencies. As the demand for more efficient data centers increases, it is important to provide better ways of ensuring consistency without affecting performance.
In recent years, there have been several research proposals around Crash Fault Tolerant (e.</description>
    </item>
    
    <item>
      <title>Survey of hash-based authentication on modern hardware</title>
      <link>https://dasya.itu.dk/for-students/proposals/archive/hashing/</link>
      <pubDate>Fri, 21 Aug 2020 00:00:00 +0000</pubDate>
      
      <guid>https://dasya.itu.dk/for-students/proposals/archive/hashing/</guid>
      <description>Hash-based authentication is an effective way of protecting passwords in software systems. Hashing obscures the original passwords, such that it cannot be recovered in case of a database breach. However, as demonstrated by our paper titled Hash-Based Authentication Revisited in the Age of High-Performance Computers, the practical security depends on which hashing algorithm is used as well as the complexity of the passwords.
The main goal of this project is to do a study on which hashing-algorithms are the standard in current software systems as well as testing the cracking capacity of these hashing-algorithms on high-performance computers and home computers.</description>
    </item>
    
    <item>
      <title>Can Permissioned Blockchains Replace Traditional Databases? Benchmarking Case Study</title>
      <link>https://dasya.itu.dk/for-students/proposals/archive/blockchainbenchmarking/</link>
      <pubDate>Tue, 18 Aug 2020 00:00:00 +0000</pubDate>
      
      <guid>https://dasya.itu.dk/for-students/proposals/archive/blockchainbenchmarking/</guid>
      <description>Blockchains are often used synonymously with crypto-currencies and unspent transaction output (UTXO) data models, but there are emerging blockchain platforms that offer a more general data model and smart contracts that can manipulate this data freely (e.g. Hyperledger Fabric [1]). As such, these platforms resemble in many ways distributed databases, storing a collection of records, organized as key-value pairs, on the ledger that smarts contracts can access and modify.
In several use-cases, permissioned ledgers are being considered as an alternative to traditional databases [2].</description>
    </item>
    
    <item>
      <title>Analysis of New Generation SSDs</title>
      <link>https://dasya.itu.dk/for-students/projects/archive/ssdcharacterization/</link>
      <pubDate>Mon, 20 Apr 2020 00:00:00 +0000</pubDate>
      
      <guid>https://dasya.itu.dk/for-students/projects/archive/ssdcharacterization/</guid>
      <description>SSDs are not a uniform class of devices. SSD landscape is quite diverse now with many new-gen much faster / customizable devices being available. Understand their performance characteristics is crucial while determining what their impact on data systems software stack should be. In this project, we would like to characterize the performance of a broad range of such SSDs (e.g., ZNS, Samsung Z-SSD, Samsung KV-SSD, Samsung Smart SSD, Intel Optane, etc.</description>
    </item>
    
    <item>
      <title>HTAP benchmarking with an HTAP/IoT workload</title>
      <link>https://dasya.itu.dk/for-students/projects/archive/iothtap/</link>
      <pubDate>Sat, 01 Feb 2020 00:00:00 +0000</pubDate>
      
      <guid>https://dasya.itu.dk/for-students/projects/archive/iothtap/</guid>
      <description>How does commonly used time series systems handle an HTAP/IoT use-case?</description>
    </item>
    
    <item>
      <title>An Analysis of Open-Source HTAP Platforms: Towards a Standardized Benchmarking Suite</title>
      <link>https://dasya.itu.dk/for-students/projects/archive/htaptpcch/</link>
      <pubDate>Sat, 01 Jun 2019 00:00:00 +0000</pubDate>
      
      <guid>https://dasya.itu.dk/for-students/projects/archive/htaptpcch/</guid>
      <description>Investigating what an HTAP benchmark needs</description>
    </item>
    
  </channel>
</rss>