Blog

Book Launch: Challenges and Perspectives of Hate Speech Research

Christian Strippel

We are thrilled to announce the release of “Challenges and Perspectives of Hate Speech Research,” a collection of 26 texts on contemporary forms of hate speech by scholars from various disciplines and countries. The anthology is co-edited by Methods Lab members Christian Strippel and Martin Emmer, together with research colleagues Sünje Paasch-Colberg and Joachim Trebbe. Divided into three sections, it covers present-day political issues and developments, provides an overview of key concepts, terms, and definitions, and offers numerous methodological perspectives on the topic. Whether you are a fellow academic researcher or a concerned netizen, this book is a must-read for anyone interested in the dynamic field of interdisciplinary hate speech research and the future of our evolving digital landscape.

Challenges and Perspectives of Hate Speech Research is open access!

This book is the result of a conference that could not take place. It is a collection of 26 texts that address and discuss the latest developments in international hate speech research from a wide range of disciplinary perspectives. This includes case studies from Brazil, Lebanon, Poland, Nigeria, and India, theoretical introductions to the concepts of hate speech, dangerous speech, incivility, toxicity, extreme speech, and dark participation, as well as reflections on methodological challenges such as scraping, annotation, datafication, implicity, explainability, and machine learning. As such, it provides a much-needed forum for cross-national and cross-disciplinary conversations in what is currently a very vibrant field of research.

Workshop Recap: Introduction to Programming and Data Analysis with R

Roland Toth
Day 1, section Introduction to Markdown (photo: Katharina Stefes).

From March 29-30, the Methods Lab organized a workshop on the use of the programming language R for working with data, led by Roland Toth. The focus was on the main principles of programming in order to understand what is happening under the hood when working with data.

Day 1 focused on the advantages of using a programming language to work with data over dedicated software such as SPSS or Stata. In the course of this, the most important principles of programming in a research context, such as functions, classes, objects, vectors, and data frames were covered. Before going into the specific tasks in the context of data analysis, the markup language Markdown in combination with R was first introduced. This allows data analyses to be not only performed, but also reported in a directly reproducible and seamlessly interrelated manner, so that entire research papers can be written using R and Markdown. The day concluded by covering the key steps and techniques in data wrangling and performing calculations of typical descriptive and inferential statistical measures, tests, and models. At the end of each section of the day, there were small tasks to be solved by the participants to apply what they had learned.

On Day 2, the data analysis section was wrapped up with a demonstration of numerous visualization methods. This was followed by a longer section in which participants were allowed to think about their own research question based on a freely available data set from the European Social Survey (ESS) and answer it in R using all the techniques they had learned. They were supported by the workshop leader, since at the beginning of working with a programming language there are often many small, unforeseen problems that can quickly lead to frustration without prior experience. Lastly, an outlook was given on what techniques and packages to familiarize oneself with once beginning to dive deeper into data analysis in R and programming in general (for example, custom functions, loops, and pipes). The workshop was concluded with a Q&A where remaining questions could be asked.

For the purpose of optimizing the training offered by the Methods Lab, a short, anonymous evaluation was conducted at the very end of the workshop. Thankfully, the participants were very satisfied with the workshop throughout and only commented that more frequent and smaller tasks might have been even better. Although this is in parts difficult to reconcile with the concept of the workshop, this feedback is appreciated and will be used to improve future offerings in this regard.

The Methods Lab would like to thank all participants for their participation and commitment and hopes that the skills learned will be of benefit to them in future research projects and other application scenarios.

Workshop: Introduction to Programming and Data Analysis with R (March 29-30, 2023)

Methods Lab

Our second workshop, Programming and Data Analysis with R, will be held on March 29 and 30 at the Institute.

During the first day of the workshop, Roland Toth (WI) will introduce and establish the fundamentals of programming in R/R Studio, combining it with Markdown. Building of the first, the second day will be dedicated to applying this knowledge to data analysis and working on a custom research question. No previous experience is necessary.

You can find more information about the workshop on its program page.

Workshop Recap: Web Scraping and API-based Data Collection

Anna Hohwü-Christensen

On March 2nd, the Methods Lab hosted its first-ever workshop, Web Scraping and API-based Data Collection. The workshop explored various techniques for accessing and gathering data from platforms using APIs and web scraping. Speakers included Florian Primig (FU Berlin), Steffen Lepa (TU Berlin), Felix Gaisbauer (WI), and Leon Wendel (WI). The workshop received an overwhelmingly positive response, with many people attending both in person and remotely. It generated plenty of discussions and concluded with a Q&A session.

Lion Wedel gives an introduction to Web-Scraping (photo: Roland Toth).

Thanks to all our presenters and participants in helping us create such a successful first event. We look forward to organizing more workshops in the future on emerging methodologies in the realm of digital research!

ECPR Winter School: Machine Learning with Big Data for Social Scientists

Roland Toth

From February 6–10, Methods Lab member Roland Toth attended the online course Machine Learning with Big Data for Social Scientists at ECPR Winter School.

The goal was to gain a deeper insight into certain machine learning methods and to be able to apply them to social science questions in particular. It was also about efficiency in handling large data sets so that they can still be processed with high performance.

Numerous materials were made available for the workshop in advance. There were videos for each session in which presentation slides on the respective topics of the session were presented in the style of a lecture. These were accompanied by appropriate literature and studies. On each of the workshop days, there were two-hour live sessions in which the content of the videos was repeated and the application of the principles was practiced live.

The first step was to set up RStudio Server on the Amazon Web Services (AWS) cloud service. This offloads the entire RStudio environment from one’s own machine, allowing handling data and calculations without burdening local resources.

Furthermore, work with the package collection tidyverse was deepened. Here, among other things, it turned out that the function vrooom from the package of the same name provides faster import of larger data sets than similar functions. In addition, it was discussed how to access external data sets directly from RStudio via SQL syntax, so that it is not necessary to import the full data sets at all.

For illustrative purposes, data sets on COVID vaccination status and election outcomes in the United States were used during the workshop. Respectively, the observations were clustered at different levels (state, county, …), which rendered the merging of the data sets difficult. Besides typical functions of data wrangling (filtering, grouping, aggregating, mapping, merging), some special machine learning methods were discussed. Here, the logic of the procedure was first demonstrated using simple linear regression models: A model is trained with a (smaller) training data set and then applied to a (larger) test data set. The model is supposed to accurately predict the outcome, but not as accurately as to overfit to the training data and perform badly on the test data – in the end, it was a question of a balance between variance and bias. During the workshop, this principle was also applied to LASSO and Ridge regression, logistic regression, and classification methods such as Support Vector Machines, Decision Trees, and Random Forests.

All in all, it was a good introduction to working with machine learning methods. However, there was limited focus on the decision criteria for choosing certain methods over others, and a strong focus on the technical implementation of the methods in R. Nevertheless, the workshop was able to clarify some open questions and provide some new techniques that will help when working with larger datasets and in data analysis.

Workshop: Web Scraping and API-based Data Collection (March 2, 2023)

Methods Lab

We hereby present the first workshop at the Institute to emerge from the methodological needs that were indicated in our institute-wide survey in December. It is titled Web Scraping and API-based Data Collection and takes place on March 2.

After an introduction to the topic by the Methods Lab team, Florian Primig (FU), Steffen Lepa (TU), Felix Gaisbauer (WI), and Lion Wedel (WI) will each present various use cases of these two data collection methods. You can find more information about the workshop on its program page.

Research Methods at the Weizenbaum Institute: Survey Results

Methods Lab

In December 2022, the Methods Lab conducted an internal survey to map out the methodological experiences and needs at the Weizenbaum Institute. Thanks to everybody who participated! We have identified specific demands and requests at the institute. Even though there already is extensive expertise for a large variety of methods and tools, many Weizenbaum scholars also expressed a wish for additional support and knowledge-building in, for instance, the following areas:

  • Data collection: Automated observation (e.g., logging, tracking), Automated content analysis, Web Scraping, API-based data collection, and Eye-Tracking
  • Data Analysis: Network Analysis, Deep/Transfer Learning, Natural Language Processing, and Classification Methods
  • Software/Tools: R, Python, and Network analysis software

With these results as our polaris, we in the Methods Lab have embarked on the expedition of developing a future methods training and consulting program suited to your needs, which we will announce shortly. In the meantime, the results of the survey hopefully serve as a launch pad for networking amongst the scholars at the Weizenbaum Institute.

Software Review: BRAT Rapid Annotation Tool

Christian Strippel

Our Methods Lab group lead and WI research associate, Christian Strippel, has written a software review of the BRAT rapid annotation tool, co-authored by Laura Laugwitz, Sünje Paasch-Colberg, Katharina Esau, and Annett Heft. The review is published in issue 4/2022 of Medien & Kommunikationswissenschaft. Read the article here.

In the context of interdisciplinary collaboration, especially with colleagues from computer science, communication and media research has for some time been confronted with a wide range of research software with which it has had little prior experience. In addition to programming lan­guages such as Python or R, these include specific tools for text analysis that represent an alterna­tive to previous variants of computer-assisted content analysis. With the brat rapid annotation tool (BRAT) we present such an alternative in this paper and review it against the background of our experience in using it. BRAT is a web-based open-source text annotation tool that was developed by an international team of computer scientists about ten years ago. The article introduces the tool and its most important features, presents examples for its use in qualitative and quantitative content analyses on the basis of three case studies, and finally evaluates it with regard to potentials and difficulties for the field.

A few notes on the Methods Lab

Methods Lab

Dear all, 

Welcome to the digital baptism of the Methods Lab blog. This blog will keep you informed about our work, future workshops, events, and other resources and materials that may be useful to you in your upcoming research.

As a unit, we are committed to three principal tasks: training, consulting, and research. We aim to assist you with all your methodological questions, issues, and needs, no matter how large or small, and to coordinate expertise at the institute. Think of us as a hub, a metaphorical Rome, if you will, where all your methods-related queries, and (non-)knowledge have a space to converge. If you have any thoughts, suggestions, or concerns, don’t hesitate to contact us – we will always lend you an ear. 

At the start of December, we asked you to participate in a survey in order to give us an overview of your expertise and needs regarding data collection, analysis, and software. With the help of the results, we have created a preliminary training program tailored to your wants and needs. To everyone who participated: thank you!

On that note, we are delighted to announce that our first official workshop will take place at the beginning of March. Besides that, we have two more workshops planned for spring.

So stay tuned for further announcements about many exciting things to come! We look forward to beginning this new chapter with you.