1SOURCE EXTRACT — arxiv-2304.09339v12Title: The Unintended Consequences of Censoring Digital Technology – Evidence from Italy's ChatGPT Ban3Authors: David H. Kreitmeir; Paul A. Raschky (Monash University)4Bibliographic record: arXiv:2304.09339v1 [econ.GN], version 1 submitted 18 Apr 2023. Abstract page: https://arxiv.org/abs/2304.09339v15Retrieved: https://arxiv.org/html/2304.09339 on 2026-10-30T04:19:51Z (SHA-256 of the retrieved HTML: d419d3955978fb42e4ea99263e206a396a33ec3ff53ae8d83abbd3db1dacaa8c)6License: CC BY 4.0 (license shown on the arXiv abstract page; https://creativecommons.org/licenses/by/4.0/). Reproduced in part with attribution.7Extract contents: title, authors and abstract; Section 3.1 'GitHub Data' (outcome definitions); Section 4 'The Effect of the Ban on Productivity' including Table 1 'The Effect of the ChatGPT Ban on GitHub Output' with its notes.8Omitted: Sections 1-2, 3.2, 5-6, Table 2, the appendices, all figures, the references. The date line printed under the author block in the HTML rendering is generated at rendering time and is not the submission date.9Rendering note: converted from the HTML rendering to plain text. Tables are rendered one row per line with " | " separating cells; in regression tables the line following a coefficient row holds the standard errors in parentheses, exactly as printed. Mathematical expressions appear as LaTeX source; non-breaking spaces were replaced by ordinary spaces. Figures are not reproduced: a value that appears only in a figure is not in this extract. No numbers were altered.10================================================================1112# The Unintended Consequences of Censoring Digital Technology – Evidence from Italy’s ChatGPT Ban1314We would like to thank Yashdeep Dahiya for outstanding research assistance. Department of Economics and SoDa Labs, Monash University. See praschky.GitHub.io and paul.raschky@monash.edu1516David Kreitmeir1718Note: Department of Economics and SoDa Labs, Monash University. See davidkreitmeir.GitHub.io and david.kreitmeir@monash.edu1920Affiliation: Paul A. Raschky2122August 24, 20262324###### Abstract2526We analyse the effects of the ban of ChatGPT, a generative pre-trained transformer chatbot, on individual productivity. We first compile data on the hourly coding output of over 8,000 professional GitHub users in Italy and other European countries to analyse the impact of the ban on individual productivity. Combining the high-frequency data with the sudden announcement of the ban in a difference-in-differences framework, we find that the output of Italian developers decreased by around 50% in the first two business days after the ban and recovered after that. Applying a synthetic control approach to daily Google search and Tor usage data shows that the ban led to a significant increase in the use of censorship bypassing tools. Our findings show that users swiftly implement strategies to bypass Internet restrictions but this adaptation activity creates short-term disruptions and hampers productivity.2728### 3.1 GitHub Data2930We access individual, real-time activity data from GitHub users in Italy (treatment), Austria and France (control) in the weeks prior and immediately after the ChatGPT ban in Italy, March 27th – April 11th 2023.3132GitHub is the world’s largest online code hosting platform, used for storing and jointly working on coding projects, so called repositories. All modifications to the GitHub repository are automatically timestamped and stored, and GitHub permits the tracking of any iterations to specific files and lines of code. The history of iterations and actions is available for anybody with access to a repository to examine and download. Every action taken by a team member is automatically recorded, keeping details about the kind and substance of the modification, the files and code lines affected, and the date those changes were performed. With GitHub’s history of developing open-source software, a significant portion of the repositories are not access restricted, meaning that the information about projects’ activity is available to everyone. As such, public GitHub repositories provide a direct, real-time measurement of labor activity of software and code developers for millions of33software and code developers worldwide (McDermott and Hansen,, 2021).3435GitHub data has already been used in empirical research to study changes in software developers’ productivity during the onset of COVID19 (Forsgren,, 2021), how COVID19 changed the daily and weekly patterns of labour allocation of individuals (McDermott and Hansen,, 2021); the impact of the effects of working from home on individuals’ productivity (Shen,, 2023), the effect of air pollution on individual output (Holub and Thies,, 2023), or analyse the relationship between social links and the likelihood of joining professional software development teams(Casalnuovo et al.,, 2015).3637Our preferred measure for GitHub users’ output are Release events. A release is a deployable version of a software project that make it available for a wider audience and easy for users to download and install the software. It typically includes a set of release notes, documentation, and binaries or source code.^4^43843940See https://docs.GitHub.com/en/repositories/releasing-projects-on-GitHub/about-releases. On an hourly and daily basis, releases are relatively rare events and we create an indicator variable that switches to one if the user has recorded at least one release event during the respective time period (hour or day).4142We also use the (log of) number of total GitHub events by a user, Events , the sum of Push and Pull events, PushPull and an aggregate Output measure based on Holub and Thies, (2023), which is the sum of Push, Pull Requests, Pull Request Comments, Commit Comments, Create, and Issues. In addition, we use information about the users organisational affiliation to distinguish between GitHub users who have entered an organisational affiliation (i.e. company, research organisation) and those without an organisational affiliation.4344We access data on individual GitHub user’s activity from and GitHub Archive which is updated daily and contains all public event data. GitHub Archive data is hosted on Google’s BigQuery warehouse system and can be accessed with a query on google’s cloud infrastructure. GitHub user information was downloaded using the GitHub GraphQL API ^5^54554647The python scripts that was written to access the GitHub user information for the respective countries is available at https://GitHub.com/sodalabsio/GitHub_scrape. Both datasets are then joined via the unique GitHub user login.4849Descriptive statistics and a balance test for the GitHub data is presented in Table A.1 in the appendix.5051## 4 The Effect of the Ban on Productivity5253To analyse the effect of the Italian ChatGPT ban on output by GitHub users, we estimate variants of the following Difference-in-Difference (DID) event study model:5455\displaystyle Y_{it}= \displaystyle\alpha_{i}+\lambda_{t}+\sum_{\tau=-3}^{-1}\beta_{\tau}D_{it}^{\tau}+\sum_{\tau=0}^{4}\beta_{\tau}D_{it}^{\tau}+\epsilon_{it}, | | | | (1)5657where Y_{it} is an indicator variable that equaling to one if user i made a Release on GitHub on day t and zero otherwise. D is a dummy variable, switching to one for observation’s in the treatment group is in period \tau and zero otherwise. \alpha_{i} is a vector of user specific fixed effects, \lambda_{t} are day (date) fixed effects, \beta are the parameters of interest and \epsilon_{it} is the error term. Standard errors are clustered at the GitHub user-level.5859The results are presented in Figure 1 showing a statistically significant drop in release likelihood in the two first business days after the ChatGPT ban was initiated.6061Figure 1: The Effect of the ChatGpt ban on GitHub Releases6263Notes: Black dots represent the coefficients from estimating the difference-in-Difference (DID) event study model from equation 1. 95% confidence intervals using robust standard errors clustered on the GitHub user-level are depicted. The horizontal axis label denotes the days before and after the ChatGPT ban was implemented. The last day prior to the ban, 31/03/23 is the left out period. The weekend days (01/02.04) after the ban was implemented are not included.6465We then proceed and estimate a difference-in-differences specification that combines the Pre and Post period. The results are presented in Table 1. In the first specification in panel A , we specify the pre period as the last Monday and Tuesday (March 27th and 28th 2023) prior to the ban and the post period as the first Monday and Tuesday (April 3rd and 4th 2023) after the implementation of the ban. Columns 1–4 present estimates for the sample of users with organisational affiliation, while columns 5–8 are the estimates for users without affiliation. Starting with the sample of GitHub users with an organisational affiliation, we find no systematic effect on the ChatGPT ban on the total number of GitHub events. However, we find a a statistically significant and negative effect on the likelihood of Release events. Considering the mean of Release in the sample of 0.024, the point translates into an approx. 50% reduction in the likelihood that a developer will have a release event recorded on GitHub in the first two business days after the ban. The estimated coefficients for Output and PushPull also have a negative sign but are not statistically significant. We do not find any systematic effects of the ban on activity by GitHub users without an organisational affiliation. Panel B contains results where the post period consists of the next three business days after the ban, Thursday, Friday (April 5th and 6th)^7^76676768We excluded April 7th because this was Good Friday as well as Monday (April 11th). None of the estimated coefficients of Treat\times Post is statistically significant and the coefficients also have a lower magnitude compared to the results in panel A . This suggests that the disruptions caused by the ban was relatively short-lived and Italian GitHub users quickly recovered their pre-ban levels of productivity.6970Table 1: The Effect of the ChatGPT Ban on GitHub Output7172| Users with Affiliation | | | | Users w/o Affiliation | | |7374| Events | Release | Output | PushPull | Events | Release | Output | PushPull7576| (1) | (2) | (3) | (4) | (5) | (6) | (7) | (8)7778| A: Pre 27/28.03 - Post 03/04.04 | | | | | | |7980\times TreatPost | 0.115 | -0.012** | -0.278 | -0.227 | 0.005 | -0.003 | 0.188 | 0.1928182| (0.109) | (0.005) | (0.295) | (0.207) | (0.120) | (0.005) | (0.221) | (0.189)8384Post | 0.052 | 0.002 | 0.453*** | 0.323*** | -0.013 | 0.002 | 0.040 | 0.0518586| (0.053) | (0.002) | (0.123) | (0.094) | (0.060) | (0.002) | (0.119) | (0.101)8788N | 18332 | 18332 | 18332 | 18332 | 14496 | 14496 | 14496 | 144968990| B: Pre 27/28/29.03 - Post 05/06/11.04 | | | | | | |9192\times TreatPost | 0.048 | -0.003 | 0.135 | 0.073 | 0.003 | 0.000 | 0.067 | 0.0589394| (0.090) | (0.004) | (0.223) | (0.163) | (0.101) | (0.004) | (0.175) | (0.142)9596Post | -0.217*** | -0.002 | -0.037 | -0.001 | -0.325*** | -0.000 | -0.112 | -0.0699798| (0.042) | (0.002) | (0.097) | (0.074) | (0.050) | (0.002) | (0.095) | (0.078)99100N | 31983 | 31983 | 31983 | 31983 | 25368 | 25368 | 25368 | 25368101102•103104Notes:105106•107108All specifications include user fixed effects. Robust standard errors are clustered on the user-level in parentheses: *p<0.1, ** p<0.5, *** p<0.01.109