Hello and welcome to Mr Ericksen’s home on the web. This isn’t so much a portfolio of my work as it is a place for me to archive my projects and processes while providing a convenient way for me to share them with others who may be interested in using them.
If you’re just browsing around, Technotes are tech-related projects I’ve worked on as an IT Director and EdSys Admin, Travel Hacks is a collection of things I’ve found helpful during since moving abroad in 2006, and Pro Tips are some short tips for making daily life a little less stressful.
The Anglo-American School of Sofia, Bulgaria has three IQAir Outdoor Air Monitors. The monitors’ data can be accessed online. However, I wanted a more robust dashboard showing the current air pollution levels (US AQI), the trend line for the recent past, and the current temperature, humidity, and barometric pressure. So, I built one that lives (almost) entirely in a Google Sheet.
Get data from the IQAir Monitor
There are a few scripts attached to the sheet (you won’t be able to see them in the sheet itself, but I’ve linked them below). The main datalogger.gs script is set to run every three minutes (to stay within our IQAir api call quota). The script reads the pm2.5, pm10, humidity, temperature, and barometric pressure, calculates the US AQI value and associated scale color, and writes that data to the AQIData tab in our spreadsheet:
Organize the Data
A formula in A2 of the CurrData tab: =QUERY(AQIData!A:K,"Select * ORDER BY A DESC LIMIT 1",0) pulls the most recent information from the AQIData tab. Formulas in L2, M2, & N2: =VLOOKUP(H2,ColorLookup!$A$2:$E$8,4,TRUE) =J2&".png" =INDEX(SiteLookup!B:B,MATCH(B2,SiteLookup!A:A,0)) look up the current condition’s description, associated color and location. This data is used to update the web page you see at the top of this post (also here: https://fava.one/aasair). Below this information, starting in row 3, we see the data from the past two hours, obtained with the following formula in cell A6: =QUERY(QUERY(AQIData!A:J,"Select A, C, D, H ORDER BY A DESC LIMIT 60",0),"SELECT * ORDER BY Col1") This data is used to create the graph, published as an image to be used in the dashboard:
Make the Data Available to a Web Page
Once we have the data set up in the spreadsheet, we need to make it available to our web page’s Javascript file (more on this below) so that it can be loaded into the page. For this we create another Google Apps Script file doGet.gs with the following code: function doGet (){ var data = SpreadsheetApp.getActiveSpreadsheet().getSheetByName("CurrData").getRange("A2:N2").getValues() return ContentService.createTextOutput(data.toString()) } Once saved, we need to click the blue “Deploy” button in the Apps Script window, give the deployment a sensible description, set “Who has access” to “Anyone”, and click “Deploy.” In the configuration panel, copy the URL and paste it into the third line of the Javascript file.
Customize Javascript File to Use Our Data
OK, now to get this into a browser window. I would recommend setting this up first locally on your computer. Once it’s all set, you can upload it to the web server of your choice. The “AirQualityDashboard” file below is a zipped archive of the pages needed to serve the dashboard. Opening the index.html file should show the current AAS dashboard. If you update the link in line #3 of the Javascript file with the URL you copied from your deployment above, you should see your monitor’s data.
Customizing your Dashboard
Our dashboard pulls data from IQAir’s website using our account’s API key. You could pull data from just about any other source that makes its json file available through an API call. I’ve created a fewotherdashboards that pull from devices registered on opensensmap.org. Each is a little different, but also similar in that they acquire their data from an API call, parse it with Javascript, and load it into the html page. You can see the code for all of the different versions by right-clicking the page and selecting “View source.” From the html source data, you’ll see the .js and .css files linked near the top. Give it a shot, change it up, make it yours. If you set up your own, shoot me a link and let me know how you updated it!
We used Google Docs for elementary progress reports. A spreadsheet and Autocrat let me create all the files and even drop them into folders by homeroom class. But that’s not what this is about.
After teachers started entering grades, the principal noticed that the grading key was missing some information. The easy fix would have been to recreate the docs and have the teachers start over. But this would have created extra work for teachers on one of their least enjoyable tasks.
A quick Google search led to a script that would allow me to edit the documents en masse. Not surprisingly, the starter script came to me via Amit at https://labnol.org. It takes the folder path containing the docs to be edited, the “search” text and the “replace” text. Then it goes through all the docs in the folder, makes a backup and then does the search/replace in each doc.
Amit’s script is effective but limited to a basic find/replace in the body text of Google Docs in one folder. I expanded it to allow formatting text in addition to find/replace in Google Doc headers, bodies, and footers across multiple folders. You can find my script here.
Rubbermaid’s 25 gallon Roughneck Tote is the best container to use as checked baggage when transporting a lot of stuff via intercontinental flights. The length + width + height dimensions are the maximum allowed by airlines, maximizing the volume per piece of baggage, they stack nicely on airport carts and the handles make loading and unloading convenient. I have used this method since 2008, moving back and forth from the U.S. to Kuwait, Nigeria and South Korea, taking a couple dozen of these totes on several dozen flights. I’ve never had a problem and never lost a tote or lid.
They’re available at most Ace Hardware stores. On Amazon.com, the shipping charges are prohibitive. But if you visit my favorite hometown Blain’s Farm and Fleet, you can get 4 of them shipped just about anywhere in the US for around $20 each. While you’re there, throw in your 14″ zip ties, colored duct tape, packing tape, and Sharpie.
The only challenge is closing them up to remain sealed during travel. But, there is an easy way of handling this. I use a 5/16″ drill bit (8mm) to put 12 holes strategically placed around the lid which accept plastic zip-ties or 16 gauge solid-core copper wire to keep the tote sealed.
It’s important to put the holes in the right place so that if you use several totes, any lid will be able to be used on any tote with the lid and tote holes lining up perfectly. Check out my video for the details:
We have several leave request forms that get processed by the Autocrat Add-on. Inevitably, Autocrat seems to get stuck and fails to run. This is an issue for us when staff are submitting forms expecting that they will be acted upon while our crack team of support staffers remain unaware that the requests have been submitted.
Whenever Autocrat runs, it adds a note logging successful completion into the cell in the last row, last column of this spreadsheet. If this cell is blank, Autocrat has failed to execute. So, I came up with this little script. It checks the form responses spreadsheet’s last row and column every 6 hours (adjustable). If that cell is empty, indicating an Autocrat failure, an email is sent to me which looks like this:
To use this yourself, click here for the script. Copy the code and paste it into a new script in your form’s spreadsheet (Tools > Script Editor). Then set a trigger for the script to run at your preferred time interval.
I use a Raspberry Pi with four drives housed in a Yottamaster USB enclosure. These are encrypted using VeraCrypt which can be a pain if/when the Pi loses power and restarts since the volumes become unmounted and inaccessible. The solution is to auto-mount the drives when the Pi starts up via the crontab.
Please note: This method requires the drive passwords to be stored in a text (shell script) file. If you need stronger security, this method is not for you.
From experience, trial and error, I know the lines I want are those ending in “-part2”.
Part 2: Create a shell script:
I now create a shell script (mount.sh) on the Desktop with the following. This script will run at startup, sleep 20 seconds to let the Pi finish all its startup stuff, and then mount the drives:
nano /home/root/Desktop/mount.sh
…and add the following. Don’t forget to replace the usb-JMicron_Generic…part2 with your drive ids from Step 1. Notice also that there is a space between part2 and /media/veracrypt1.
OK, this one is the simps. I have a Raspberry Pi connected to a monitor. Whenever the Pi starts up, I want it to automatically load my air quality dashboard in full-screen (kiosk) mode. I don’t want to use a keyboard, mouse or other user action, I just want it to start up and show a webpage, using the full-screen kiosk mode.
Here’s how to do it:
Edit the lxsession autostart file with the following:
That’s it. Whenever your Pi reboots, it’ll load up the webpage (in this case https://kis.support/h200).
Pro Tip: The Rapsberry Pi’s default screensaver can be a pain in the neck. I disabled it by installing xscreensaver with:
sudo apt install xscreensaver
Then, click the Raspberry “Home” button > Preferences > Screensaver. In the top dropdown “Mode” menu, select “Disable Screen Saver”. Then sit back and get ready for some serious burn-in.
Note: This is a draft post - published for Paul to find more easily. It's not complete as long as this paragraph is here, but the initial steps will be needed before progressing further.
Info for setting static ip address and access from off campus
Samba Server Setup
Install Samba
sudo apt update
sudo apt install samba
Samba setup
mkdir /home/<user>/sambashare/
sudo nano /etc/samba/smb.conf
Add the following to smb.conf:
[sambashare]
comment = Samba on Ubuntu
path = /home/username/sambashare
read only = no
browsable = yes
Edward, one of our 11th grade students on the school’s yearbook team wanted to build an index of page numbers where each student appeared. Traditionally, this would entail multiple students going through every page and recording the page number for each student appearing on that page. Inevitably, some students get missed, errors are made, and some pages get skipped.
Edward, recognizing an opportunity to leverage his programming skills, wrote a Python script to collect the information in a much more efficient manner. His script reads two columns from a Google Spreadsheet into lists named name and nameraw. Then, for each name in the lists, the script searches each page of the yearbook pdf and logs each page number where the name is located. Finally, this data is written back to the Google sheet.
This script leverages Google sheets, but with minor alteration, it could easily use locally stored files instead. Note that this script depends on a number of dependencies, so don’t forget to add those that you may not yet have installed (PyPDF2, re, pathlib, and the relevant Google auth and client libraries). If you’re unfamiliar with the Google python libraries, well, that will need to be another Google search. However, if you use local files rather than reading from a Google sheet, those libraries (and the code between the dashed lines) could be excluded. You would just need to replace those lines with a couple others that would open your csv file with the list(s) of names.
This is Edward’s script and I had no hand in creating or using it. If you want to use it yourself, you’re welcome to do so. If you get stuck, check with one of your programming students or teachers first. If you’re still stuck, comment below and I’ll help out if I can.
from __future__ import print_function
import os.path
from PyPDF2 import PdfFileReader, PdfFileWriter
from pathlib import Path
import re
import PyPDF2
#-----------------------------------------------------
from google.auth.transport.requests import Request
from google.oauth2.credentials import Credentials
from googleapiclient.discovery import build
from googleapiclient.errors import HttpError
from google.oauth2 import service_account
# Note that you will need to set up your own Google API credentials if
# you're using Google Sheets. This part is beyond the scope of this post.
# But you can find how to do this with a quick google search.
SERVICE_ACCOUNT_FILE = 'keys.json'
SCOPES = ['https://www.googleapis.com/auth/spreadsheets']
creds = None
creds = service_account.Credentials.from_service_account_file(
SERVICE_ACCOUNT_FILE, scopes=SCOPES)
# The ID and range of the spreadsheet. Note that the ID below is fake
# (we're not going to post the real one on the interwebs)
# Make sure you update the ID to refer to your spreadsheet
SPREADSHEET_ID = '1DQyjh1-7T9jjU7kmg6-TNcjsCtnCspWiMbv3t2mJeM'
service = build('sheets', 'v4', credentials=creds)
# Call the Sheets API
sheet = service.spreadsheets()
result = sheet.values().get(spreadsheetId=SPREADSHEET_ID,
range="Sheet1!B1:B508").execute()
result2 = sheet.values().get(spreadsheetId=SPREADSHEET_ID,
range="Sheet1!A1:A508").execute()
#------------------------------------------------------------
values = result.get('values')
values2 = result2.get('values')
name = []
nameraw = []
#put names from values and values2 into lists
for x in values:
for i in x:
name.append(i)
for x in values2:
for i in x:
nameraw.append(i)
#Open the Yearbook pdf file
pdf = PdfFileReader('yearbook1.pdf')
#create a 2-D array for names & associated page numbers
pagesfinal = [[]]
#This is where everything happens. For each name, add it to pagesfinal.
#Then open each page in the pdf file and search it for the current name.
#If a version of the name is found, append the page number to the student's page list.
for i in range(len(name)):
print(nameraw[i])
pagesfinal.append([])
for page_num in range (pdf.numPages):
pageobj = pdf.getPage(page_num)
pageinfo = pageobj.extractText()
pageinfo = ''.join(pageinfo.split())
name[i]= ''.join(str(name[i]).split())
nameraw[i] = ''.join(str(nameraw[i]).split())
if (re.search(name[i], pageinfo)) or (re.search(nameraw[i], pageinfo)) or (re.search(name[i].upper(), pageinfo)):
pagesfinal[i].append(page_num +1)
print(pagesfinal[i])
#When the above loop completes, the following line writes the data back to the Google sheet
request = sheet.values().update(spreadsheetId=SPREADSHEET_ID, range="Sheet1!C1", valueInputOption = "USER_ENTERED", body={"values":pagesfinal}).execute()
Long story short? I made an RPi sound clip player using a tft touchscreen, pygame, and movie quotes found on YouTube. It starts with a small, 3.5″ touchscreen whose drivers are installed using the instructions here. For your convenience, they are replicated below.
Just enter these lines into Terminal to get the screen set up.
This should get the screen running properly. If you have issues with axes being reversed on the screen (like you touch the right side and the cursor shows up on the left) the page linked above has some suggestions. If those don’t help, check out Teng Fone’s post on Medium.
OK, now (hopefully) the screen is working and we can work on the code. I used code from Garth Vander Houwen’s Pi tft menu project as a starting point, added some audio files, and came up with a project that presently shows this screen on my Raspberry Pi:
Sounds Player Screen
You might guess some (or all) of the audio files I used. If not, you can download them from here.
The Python script to get it all running is below (or access it here). Connect the audio output to your speakers or headphones and click away. Examining the code should make it relatively easy to modify it to change the sounds, number of options, etc.
import sys, pygame, time, subprocess, os
from pygame.locals import *
from pygame import mixer
from subprocess import *
os.environ["SDL_FBDEV"] = "/dev/fb1"
os.environ["SDL_MOUSEDEV"] = "/dev/input/touchscreen"
os.environ["SDL_MOUSEDRV"] = "TSLIB"
# Initialize pygame modules individually (to avoid ALSA errors) and hide mouse
pygame.font.init()
pygame.display.init()
pygame.mouse.set_visible(0)
pygame.display.toggle_fullscreen
# define function for printing text in a specific place with a specific width and height with a specific colour and border
def make_button(text, xpo, ypo, height, width, colour):
font=pygame.font.Font(None,42)
label=font.render(str(text), 1, (colour))
screen.blit(label,(xpo,ypo))
pygame.draw.rect(screen, blue, (xpo-10,ypo-10,width,height),3)
# define function for printing text in a specific place with a specific colour
def make_label(text, xpo, ypo, fontsize, colour):
font=pygame.font.Font(None,fontsize)
label=font.render(str(text), 1, (colour))
screen.blit(label,(xpo,ypo))
# define function that checks for touch location
def on_touch():
# get the position that was touched
touch_pos = (pygame.mouse.get_pos() [0], pygame.mouse.get_pos() [1])
# x_min x_max y_min y_max
# button 1 event
if 30 <= touch_pos[0] <= 240 and 30 <= touch_pos[1] <=85:
button(1)
# button 2 event
if 260 <= touch_pos[0] <= 470 and 30 <= touch_pos[1] <=85:
button(2)
# button 3 event
if 30 <= touch_pos[0] <= 240 and 105 <= touch_pos[1] <=160:
button(3)
# button 4 event
if 260 <= touch_pos[0] <= 470 and 105 <= touch_pos[1] <=160:
button(4)
# button 5 event
if 30 <= touch_pos[0] <= 240 and 180 <= touch_pos[1] <=235:
button(5)
# button 6 event
if 260 <= touch_pos[0] <= 470 and 180 <= touch_pos[1] <=235:
button(6)
# button 7 event
if 30 <= touch_pos[0] <= 240 and 255 <= touch_pos[1] <=310:
button(7)
# button 8 event
if 260 <= touch_pos[0] <= 470 and 255 <= touch_pos[1] <=310:
button(8)
# Define each button press action
def button(number):
print("You pressed button", number)
if number == 1:
#time.sleep(0.2) #do something interesting here
mixer.init()
mixer.music.load('Illbeback.mp3')
mixer.music.set_volume(1)
mixer.music.play()
time.sleep(5)
#sys.exit()
if number == 2:
#time.sleep(5) #do something interesting here
#sys.exit()
mixer.init()
mixer.music.load('wickedsmart.mp3')
mixer.music.set_volume(1)
mixer.music.play()
time.sleep(5)
if number == 3:
#time.sleep(5) #do something interesting here
#sys.exit()
mixer.init()
mixer.music.load('thatlldopig.mp3')
mixer.music.set_volume(1)
mixer.music.play()
time.sleep(5)
if number == 4:
#time.sleep(5) #do something interesting here
#sys.exit()
mixer.init()
mixer.music.load('killingmesmalls.mp3')
mixer.music.set_volume(1)
mixer.music.play()
time.sleep(5)
if number == 5:
#time.sleep(5) #do something interesting here
#sys.exit()
mixer.init()
mixer.music.load('failuretocommunicate.mp3')
mixer.music.set_volume(1)
mixer.music.play()
time.sleep(5)
if number == 6:
#time.sleep(5) #do something interesting here
#sys.exit()
mixer.init()
mixer.music.load('goodafternoon.mp3')
mixer.music.set_volume(1)
mixer.music.play()
time.sleep(5)
if number == 7:
time.sleep(2) #do something interesting here
#sys.exit()
if number == 8:
time.sleep(5) #do something interesting here
sys.exit()
#colors R G B
white = (255, 255, 255)
red = (255, 0, 0)
green = ( 0, 255, 0)
blue = ( 0, 0, 255)
black = ( 0, 0, 0)
cyan = ( 50, 255, 255)
magenta = (255, 0, 255)
yellow = (255, 255, 0)
orange = (255, 127, 0)
# Set up the base menu you can customize your menu with the colors above
#set size of the screen
size = width, height = 480, 320
screen = pygame.display.set_mode(size)
# Background Color
screen.fill(black)
# Outer Border
pygame.draw.rect(screen, blue, (0,0,480,320),10)
# Buttons and labels
# First Row
make_button("I'll be back", 30, 30, 55, 210, blue)
make_button("Wicked Smart", 260, 30, 55, 210, blue)
# Second Row
make_button("That'll Do", 30, 105, 55, 210, blue)
make_button("Killing me", 260, 105, 55, 210, blue)
# Third Row
make_button("Failure", 30, 180, 55, 210, blue)
make_button("Good Night", 260, 180, 55, 210, blue)
# Fourth Row
make_button("Don't do nothin", 30, 255, 55, 210, blue)
make_button("Exit", 260, 255, 55, 210, blue)
#While loop to manage touch screen inputs
while 1:
for event in pygame.event.get():
if event.type == pygame.MOUSEBUTTONDOWN:
pos = (pygame.mouse.get_pos() [0], pygame.mouse.get_pos() [1])
on_touch()
#ensure there is always a safe way to end the program if the touch screen fails
if event.type == KEYDOWN:
if event.key == K_ESCAPE:
sys.exit()
pygame.display.update()
## Reduce CPU utilisation
time.sleep(0.1)
We had tried a few years ago to get some ancient MacBooks up and running with various Linux distros. But our particular model had challenging WiFi hardware which made it impractical.
I recently took another shot at reinvigorating our Early 2011 MacBook Pros with Ubuntu and found that a few terminal commands would get things working. I used Andy Bleaden’s steps from this AskUbuntu answer. I’ve pasted the steps below to ensure I always have ready access to it.
From Andy Bleaden: I always recommend removing and reinstalling the broadcom drivers using your terminal
In a terminal type the following command
sudo apt-get purge bcmwl-kernel-source
then
sudo apt-get install bcmwl-kernel-source
This will then rebuild your driver.
You can either restart your pc or if this is a pain type the following commands in the terminal which will ‘switch on’ your wireless
Suppose a student tests positive for COVID-19. Here’s how we quickly identify potentially exposed classmates. There’s a sample spreadsheet here that you can use. Just make a copy, follow the steps below and paste the export into cell A1 of the PS_DataDump tab. If that link breaks, you can download an Excel version here.
In our ever increasing efforts to protect student confidentiality and personal information, we password protect student report cards and test results when emailing them to parents. This helps protect the information in the unlikely event that an email gets sent to the incorrect address.
To do this, we generate the reports from PowerSchool or Google Docs, typically in a Firstname Lastname grade # Progress Report.pdf format. These are put into a folder (in this case, the folder is ES_T3_PDFs) there is also a filedata.csv file that has each file’s password in the first column, the original filename in column 8, and the new filename in column 9.
The python script below then runs, opens each report, creates a new file object, password protects it, and writes it to a new folder (Secure_ES_T3_PDFs).
import PyPDF2
import csv
import sys
#Open csv with password,filename,newfilename
c = open('filedata.csv', 'r')
# Create a reader object to store the data in filedata.csv
reader = csv.reader(c, delimiter=',')
# Process each row of data
count = 0
for row in reader:
# The password located in the first column
password = str(row[0])
# The current (original) filename in "firstname lastname grade # Progress Report - Student_Number" format
currFileName = row[7]
# New filename is the same as original but without the Student_Number
newFileName = row[8]
# Skip the header row
if (password != "Password"): # Skip the first row with "Password" in first column
# print row # every 10th row - just to monitor progress
if (count % 10 == 0):
print(count)
# Open non-encrypted file
pdfFile = open("PasswordProtect/ES_T3_PDFs/"+currFileName, 'rb')
#coverLetter = open("PasswordProtect/coverLetter.pdf", 'rb')
# Create reader and writer objects
pdfReader = PyPDF2.PdfFileReader(pdfFile)
#pdfReader02 = PyPDF2.PdfFileReader(coverLetter)
pdfWriter = PyPDF2.PdfFileWriter()
# The next 2 lines put the welcome letter at the beginning of the new file
#print("Inserting Cover Letter")
#for pageNum in range(pdfReader02.numPages):
# pdfWriter.addPage(pdfReader02.getPage(pageNum))
# Add all pages to writer for each page in input file, add it to the output file
for pageNum in range(pdfReader.numPages):
pdfWriter.addPage(pdfReader.getPage(pageNum))
# Encrypt with password
pdfWriter.encrypt(password)
# Write it to an output file
resultPdf = open("PasswordProtect/Secure_ES_T3_PDFs/"+newFileName, 'wb')
pdfWriter.write(resultPdf)
resultPdf.close()
count += 1