From here:
# lofiadm -a /path/to/cd.iso
returns (for first image): /dev/lofi/1
mount -o ro -F hsfs /dev/lofi/1 /mnt/iso1
To unmount:
# umount /mnt/iso1
# lofiadm -d /dev/lofi/1
Moving GoDaddy DNS to AWS Route 53
Before changing the DNS settings on GoDaddy, set up Route 53 to manage DNS for your domain first, because you’ll need the AWS DNS server names when updating the GoDaddy DNS config.
In the AWS Console, go to Route 53, then Hosted Zones, and press the ‘Created Hosted Zone’ button:
Enter your domain name, select ‘Public Hosted Zone’ and press ‘Create’:
At this point Route 53 will have assigned a list of DNS nameservers for your domain – remember this list for when you update the GoDaddy config
Next, press ‘Create Record Set’, select Type A record and enter the name of your subdomain, e.g. www, and enter the IP address of your server that this name should resolve to:
Now let’s update the GoDaddy config. By default, here’s the DNS entries managed by GoDaddy when you register a domain with them:
First step, cancel the GoDaddy nameservers. Do this from the ‘Change’ button:
Change the type to Custom:
Then enter the dns server names from Route 53 and press ‘Save’. You should now be done. Assuming the setup on Route 53 has propagated, hit your domain name in a browser and hopefully you’re up and running.
Creating a new AWS Lambda using the AWS CLI
It’s pretty easy to set up and configure a new AWS Lambda with the AWS Console, but if you’re iterating on some changes and need to redeploy a few times, the AWS CLI makes it pretty easy.
To create a new Lambda, assuming you have a .zip packaged up and ready to go:
aws lambda create-function --function-name example-lambda --zip-file fileb://example-lambda.zip --handler index.handler --runtime nodejs8.10 --role arn:aws:iam::role-id-here:role/lambda-role
Extracting (scraping) webpage content with Puppeteer
I’m working on a personal project to extract some content from a number of websites. This idea started out trying to use a REST api to a site but it turned out to be far more complicated involving far more steps that I was prepare to invest the time in to get working, so I realized I could just scrape their HTML content instead to get what I was looking for.
There are many HTML scraping and parsing libraries. I took a look at x-ray and a few others, but what I discovered is that many sites detect the fact that you’re not browsing the site in a real browser (presumably from checking your user-agent and cookies etc) and then force you into completing CAPTCHAs etc to prove that you’re not a robot.
I then stumbled across Apify, and more specifically Puppeteer. I think Apify does far more than I need for this little project. Instead, since Apify can also use Puppeteer under the covers, I found that just using Puppeteer directly does all that I need.
Here’s a small script for extracting some text from an example site:
const puppeteer = require('puppeteer');
(async () => {
const browser = await puppeteer.launch();
const page = await browser.newPage();
await page.goto('https://www.example-website.com');
const extractedValue = await page.$eval('#element-id', el => el.innerHTML);
console.log('extracted value: ' + extractedValue);
await browser.close();
})();