The lists below give you a idea of what I’m working on. I tend to announce significant news on Blot’s Twitter account. Please don’t hesitate to contact me if you have any questions.
Done

Updated tracking code embed
12 minutes ago

Updated analytics embed code to respect DNT
41 minutes ago

Use cookie-less youtube domain for default video embeds
an hour ago

Added script to remove conflicting template directories
3 hours ago

Archive old scripts
4 hours ago

Updated package.json
a day ago

Removed remove from backup script
a day ago

Initial commit
a day ago

Updated guides to using the importer scripts
a day ago

Added support for uppercase templates directory
2 days ago

Fixes check against error message
2 days ago

Updated check against error from git
2 days ago

Don't error when removing a file which didn't exist
2 days ago

Added pandoc to development guide
2 days ago

Updated development guide
2 days ago

Added script to build an entry from a path
2 days ago

Rebuild script now accepts a link to a source file
2 days ago

Improved script to get an entry from a URL
2 days ago

Added guide to rebuild script
2 days ago

Updated script to rebuild a single entry
2 days ago

Fix failing tests in notAllowed.js Fix issues with hardcoded paths. Utilize the $BLOT_DIRECTORY env var to fix hardoding issues.
3 days ago

Updated guide to setting up a test user in development guide
3 days ago

Updated scripts to create test users and blogs
3 days ago

Rename '?json=true' => '?debug=true' Rename the ?json=true feature to a more-appropriate ?debug=true.
3 days ago

Updated development environment guide
3 days ago

Merge remote-tracking branch 'origin/master' into local-dev-env
3 days ago

Update local dev env docs from process
3 days ago

Detailed notes for wildcard subdomain setup
3 days ago

Fixed typo in documentation
4 days ago

Updated email for git client
8 days ago

Re-enabled support for redirect after log in
8 days ago

Updated email for git users
8 days ago

Updated email to users about the git client
8 days ago

Added email to notify people using the git client
8 days ago

Comments
8 days ago

Tuning of demo script
8 days ago

Added template email
8 days ago

Export send method from email module so script can use it
8 days ago

Updated readme for photos template
8 days ago

Fixed bug in save folder script
8 days ago

Removed old photo template
8 days ago

Hover states for buttons on photo page
8 days ago

Improved view on small screens
8 days ago

Simplified navigation on mobile
8 days ago

Merge
8 days ago

Remove unsupported NGINX directive
8 days ago

New NGINX directives to improve file download time
8 days ago

Fixed spacing bug
8 days ago

Updated readme and about page
8 days ago

Added nested folder post to demo folder
8 days ago

Added typeset.css
8 days ago

Fixed old close button and added left/right arroy key navigaiton
8 days ago

Changed hover for next/previous buttons
8 days ago

Made spacing abstract
9 days ago

Added a few new photos to test folder
9 days ago

Changed default behaviour
9 days ago

Add new condition to catch old dates
9 days ago

Added script to catch old dates
9 days ago

Improved script to get entry from preview url
9 days ago

New scripts for search for duplicate blog posts
9 days ago

Updated readme
9 days ago

To do

Invesigate issue with images and Facebook's preview. Tell John B.

Write script to remove 'Templates' bug folder in blogs with the Dropbox client.

Finish new documentation and logo

  • Use these UI templates
  • Add documentation for each client and an explanation for how to mirror blot blog repo on Github or Gitlab then tell.
  • Inline all CSS for performance?
  • Render the formatting guide navigation on the server
  • Make reference page searchable
  • Add types and examples to items on reference page
  • Add a resource page to the documentation with guides like Chad's And useful text editors like this one recommended by Andrew

Add new variable for last-build-time for a blog, and use this forin the sites' RSS feeds. Tell Shawn

Record new demo video

  • Show sites I run using Blot
  • "Bring your own interface" show demo of simple custom text editor built in electron or something which has autocomplete tags, drag and drop images, explain that you can build something like this yourself.
  • Blot's developer blog, a conventional blog, show using different text editors
  • My visual scrapbook on the archives theme: shows tag folders, photo blog
  • My personal site: simple landing page, edit with a doc file?

On January 21st, re-announce price increase for new customers to $30 a year. This will not affect existing customers.

On February 1st:

  • Increase price for new customers to $30 a year. This will not affect existing customers.
  • Announce new archive template, documentation and video, by linking to archive template page

A good easy task for Paul would be replacing some of the assert() tests which run every time the server starts with Jasmine tests that run via npm test.

Use email + token for git client authentication instead of username. This means that users with multiple blogs don't need to retype their credentials each time. Tell Jamie

Finish support for RFC3339 dates and tell Shawn.

Fix bug with metadata parsing a URL on the first line of a file and tell David

Are people who have cancelled their subscription notified 1 week before their subscription expires?

Finish archive template

Tell Chris, Nash and John know about new themes

Why are images downloading so slowly on the portfolio theme? Should I go back to using cloudfront?

Fix bug with git client which prevent Jamie's first 9000 posts appearing.

Fix bug with gifs and the image cacher. Animated gifs from imgur.com were not playing, just the first frame was fetched. Tell Oleg

Fix bug with double escaped embedded ampersands then tell Gavin and Ryan his

Fix Anders image path bug. A file titled "_på besøg hos gomorgen danmark.jpg" cannot be embedded in a blog post. Write test which ensures this doesn't happen again. This should also fix bug with case-sensitive paths to thumbnails + Dropbox client and tell Jan-Erik on Twitter DMs. Make resolve work more impressively, attempt to resolve a path in a case insensitive manner. Or is this a good idea? Maybe we should only resolve paths which match stored metadata? Or should we make a best-effort? As long as we are resolving case-only it should be fine... Tell Michael it now works. This should also fix bug with accents in image paths for Wesley. Incorporate retries into the thumbnail fetcher...

Fix bug with template editor which resets content of a view. Follow up with Nathan who has extensive steps to reproduce, and John Fix bugs with git removed / renamed file unit test on Travis

Fix bug with image minification which produces larger file than source file and tell Jan

Fix bug with pandoc's video embed feature which automatically adds the autoplay attribute when turning a raw url to a video into a video player then tell Wesley

Fix bug which means that a date specified in a file's path takes precedence over a date specified in the file's metadata. Current behaviour conflicts with the documentation. Tell Sean. CANNOT REPRODUCE.

Determine cause of Markdown converter failure for Dropbox/Apps/Strange encoding bug

Fix bug with thumbnails and tell John

Fix bug with rename catcher which allows two posts to share a guid. It caused a bug with Disqus comments. To reproduce this bug: Rename an entry. Create new entry with old name. Both entries have same GUID.

Fix bug which occurs when you change your username while using the Git client (caused by the broken repo url) and tell Koen

Fix Kevin's URL encoding bug. Each entry's url property is not encoded as a URI component on the server but it needs to be.

Fix bug with case-sensitivity when transfering from Git to Dropbox and tell Shantesh

Fix bug with .emf files in Word Document and follow up with Todd. Can we convert EMFs? Can we pass a flag to pandoc to let them deal with it? Is this just caused by Tiff files? I need a Windows machine to test this.

Markdown bugs

  • Fix issue with teaser generator that locks up a build process, sometimes for 10+ seconds.

  • Fix bug with blockquotes and tell Kerim. Multiple ">" symbols on the blank paragraphs between other quoted text are not formatting properly.

  • Fix bug with indented code in pre tags and tell Michael

Metadata bugs

  • Fix permalink issue with periods and tell Farzain

  • Fix bug generating summary when title metadata is set and tell Amit

  • Fix encoding bug with greek URLs then tell Rodericus know

  • Fix bug with how the date parser. It doesn't handles a space (or lack of space) between the date and the time. For example, '2017-08-27 18:16:59' works but '2017-08-27-18:16:59' doesn't

  • Fix bug parsing ISO8601 date format and tell Thomas

  • Fix bug in metadata parser which gets tripped by a URL on the first line of the file then tell Jan, Pete and Kim know

  • Fix bug with case sensitivity for tag folders. Need to recursively check all directories for proper case when extracting tags then tell Thomas

  • Fix bugs with RSS feeds validation. Perhaps extend absoluteURLs helper function? Tell John


Research state of static site generators:

Add button to clear 404 log and tell Jamie

Add frequency indicator for each route 404 log and tell Jamie

Create a status page and uptime monitor and tell Amit

Start quarterly newsletter with improvements, changes, send first edition on the first day of Spring

Prune redis keys and begin storing more on disk

Use a redis analysis tool to see if I can squeeze more out of REDIS

Generate list of external API dependencies and follow changes for each

Add hasBreakpoint property to entry to allow greater control over display of {{{teaser}}} and tell Pratik

Generate thumbnails for gifs and tell Mike

Add daemon for zero-downtime node restart

Add way to auto-refresh page during theme development on preview subdomains. Tell Ryan

Add way to filter entries by post type (e.g. photo) and tell Justin.

Finish re-write of template system

  • Add persona/cargo style customization buttons
    • Serve previews of templates from a domain with HTTPS
    • Add iframe of site in edit page of template editor
    • Work out how to make live modifications quickly to a CSS file for preview purposes
  • Re-do url redirector to use route-parser and properly support regular expressions
  • Ask to confirm, but remove files from blog folder when disabling local editing
  • Add support for 'creating' a template inside '/Templates/'
  • Move to uuid based template IDs instead of slug
  • Read and write package.json for local editing, then tell Aurynn and Brian know when it's possible to set variables locally
  • Allow paginated list of entries on other pages and tell Kevin
  • Fix bug with title and partials in local editing then tell Luke and Frank
  • Add a popular entry list
  • Add a related entry list and tell Thomas know

Add support for YAML-style custom metadata and tell Shibel and Casey and Amit

Support 2FA (Two factor authentication)

Subscription refactor

  • Add support for subscriptions via PayPal
  • Different payment methods per blog
  • Seperate blog subscriptions behind the scenes to avoid the crazy calculations. Think of them like domains, you wouldn't do what Blot is doing for those...
  • Fix bug with restarting expired subscriptions and tell Matt

Move to Linode

Add nice import step under 'Services' and as part of sign up

Backups

  • Add hourly local redis rdb dumps
  • Add script to roll back into hourly local db dumps and remote backups
  • Delete backups older than a month from s3 automatically
  • Archive logfiles with backups and wipe on a rolling basis

Create script to export Blot sites to common formats like Wordpress and let Roberto know

Increase annual price to $40. This will not affect existing customers.


Create an API for Blot

Allow logged in users to see public homepage. Perhaps use dashboard.blot.im for dashboard?

  • Add a slack.com style dropdown on the public homepage for logged in users which takes them to the dashboard for their sites.

When the user's blog does not have a client, client.write and client.remove need to remove the files from the source folder. Create some kind of local client which we fall back and use when none is configured?

Add tool to services page which would ensure that all posts in the folder had a date as part of their filename or metadata. Tell Nash

Work out how to host podcasts on Blot and tell Adrian

Move to using unix socket with redis client per documentation for better throughput. Read this issue first, I might need to make some user group permissions tweaks to ensure things are secure.

Add support for IPv6 and tell Raul

Increase default quality for sharp's output images

Client.write does not propogate sync errors... to demonstrate this, revoke dropbox token then try to enable local editing.

Re-enable image minifier and fix the bugs it creates

Can we keep the pandoc child_process running and pipe stuff in and out for speed? Measure before after to ensure this helps

Webloc converter

  • Generate screenshots as thumbnails for webloc posts perhaps using pupeteer and PNG8, which seems efficient for screenshots
  • Download the webpage for bookmark files and try to extract title + summary

Prune package.json

Cluster the main process. How will I verify that there is not statefullness somewhere in the server? I also want the main 'server' running on different threads to the CPU intensive stuff like image processing. Will this fix the bug with additional child processes if main process runs out of memory? Something wasn't being killed during the Nash WAV bug of August, 2018. There were duplicate node rebuild processes running.

Fix bugs with RSS feeds validation. Perhaps extend absoluteURLs helper function? Tell John

Add support for Microformats in the default themes. Tell Amit.

Add support for Micropub in Blot's API. Tell Amit.

Add support for HTTPS on preview subdomains

Add public share url for templates and tell Marcus

Distribute static built blogs on dat or something similar

Ensure the nginx service can be controlled properly using Upstart. It seems like Monit's attempts to reboot the service which failed, caused the downtime. Potentially worth reviewing commands in this: https://gist.github.com/andmej/1953239

Add an EXPIRY to the log entries for a blog's 404 log

Reconsider default slug length or add new short slug property and tell Josh

Set up Dependabot to automate dependency upgrade PRs

Make dashboard requests idempotent to prevent multiple form resubmits, multiple new blogs created accidentally? More information about idempotent requests

Follow up with Christian about DataValet blocking

Work out why Pandoc cannot handle 'linked' images (instead of conventionally embedded images). For instructiosn on reproducing bug, see SG's email and follow up when resolved.

Look into mirroring a site across multiple domains and follow up with Thomas

Create server dashboard to visualize load etc. using something like this: https://github.com/GitSquared/edex-ui or https://github.com/yaronn/blessed-contrib

Move to cool user subdomains? Pretty to proper blog IDs instead of integers

Self-hosting documentation then tell Jake and Mohammed

  • How do we share info, like a link on a menu, or a header image across themes? Could there be a shared info repository that themes could access?
  • add support for dynamic partials to make collections possible, e.g. {{> /{tag}.html}} ?
  • Add neat interface to customize blog level variables?
  • How do we transition from a global menu to one that the themes have control over? How do we share existing links between themes? How do we deal with the order of pages in a user's folder?
  • How do we transition from a global date display format to one that themes have control over?
  • Port the jekyll theme Neocactus to Blot and document the process then tell Robert
  • Install and test a few of these static site generators
  • Make themes file or folder based
  • Consider making file-based theme directory a git repo and using this to implement basic undo-redo functionality.
  • Disable re-rendering for locals
  • Add better customization options
  • Local theme editing does not clear cache
  • Use Hogan for precompiling and rendering themes?
  • Parse tokens and params from routes and tell Jason
  • Add way to allow all entry lists to access {{#months}} sorting options just like the archives page.
  • Fix Frank's strange theme bug
  • Warn users that underscore will not work for hidden pages
  • Fix _ entries to true public files, tell john & other folks who depend on the menu: yes, page: no side effect
  • Tell Rodrigo don't write previews for _ posts
  • Add support for fetching only some properties of an entry (ideally only those that are used). prevent some properties from being fetched in some lists (html, for example in all_entries). Would be a good candidate for hgetall or hget?

Dashboard

  • Add a broken link checker
  • Dumb quotes are still smartified, even without typeset enabled, possibly by pandoc?
  • Tolerate missing 'www' in personal domain field on dashboard for users with a custom domain when checking validity
  • Undo option for form changes
  • Add transactional emails notifying user of changes to their email or password.
  • Implement a flags page for toggling all the settings (including hidden ones) for a given blog
  • Route requests to new dashboard if toggle is on to allow thorough testing
  • When a user pastes the whole tracking script into the preferences page on the dashboard, strip out everything except the ID which we need... perhaps create a page explaining what is happening before doing this.
  • Handle noscript on dashboard / signup gracefully (remove all dashboard js?)
  • Allow users who are restarting an account with multiple blogs to disable some before restarting.
  • Take a look at Notion and Cargo for some neat ideas

Public site

  • Log 404s on the public site to identify neccessary redirects
  • Personalize the documentation for logged in users

Add support for native PDF embeds in posts, just put a link to a PDF or a path, e.g. /_assets/file.pdf --> would become a nice embed.

Add support for native MP3 embeds in posts, just put a link to an MP3 or a path, e.g. /_assets/file.mp3 --> would become a nice embed.

Fix bug with footnote links in a teaser from #frag to {{permalink}}#frag

File converters / codecs

  • Video posts (.mp4)
  • OPML files and tell John
  • Audio posts (.mp3 for now?) and tell Kevin
  • Multi-file posts from inside one folder? 'Folder>' Tell Kevin, Nash and Roberto
  • Multi-file posts with the same name but different extension (image.txt and image.jpg)
  • Markdown Write a pandoc compatible markdown converter in javascript to resolve some of the performance issues with pandoc. Perhaps just use Markdown-it
  • Add support for checkboxes and tell Matt and Shridhar

  • Add support for Pelican-style metadata in HTML posts using

  • Expose exif data on Photo posts? See if you can add comments to image metadata and tell Riley, also tell Mike

Clients

Allow Blot to fallback to client.read if the file does not exist on the blot server. Say the harddrive is wiped, we still would like to serve blog files

Sync

  • Re-implement folder verification feature and make use of the local content hash computation script to verify we have the correct version of a given file
  • Make the sync / rebuild proceses run with unpriviledged user permissions to ensure shit isnt fucked with user input... – Re-instate feature to check if a rogue sync took down the server and run sync on a seperate process
  • Add method to pause syncing and prevent future syncs then use this method with the create/remove blog migration too.
  • Ensure sync script is run by less priveledged user (just access to /tmp ? /blogs/{{ID}})?

Buy the .com

  • Remember to bump LetsEncrypt rate limits if needed
  • Remember to transfer Dropbox webhooks to new domain on the Dropbox developers console

Incorporate

Add support for other payment methods

  • Bitcoin and tell Chaz
  • Paypal

Support embedding an image in a post by copy-pasting the Dropbox share link

Increase price for new customers to $60 a year. This will not affect existing customers.


Git client:

  • Backdate existing commits (perhaps set file ctime using info from git log?) This would sidestep the frustration experienced by Gavin when he imported an existing repository.
  • Extend sync lock during long syncs
  • Write test to simulate process dying and restarting mid-pull. Does the client recover? What happens if a pull fails midway? Does git recover?
  • Write tests for a series of random client operations (pull, add, push, move, reset, delete) that can be seeded and reliably re-run in the case of failure.
  • Move to neat promise chain api when 2.0 comes out
  • Test that client must keep sending new entries and deleted entries when it recieved an error from entry.build otherwise you get ghost posts...
  • send nice error message with instructions for 413 request too large: "git reset HEAD^" etc...
  • Thoroughly document:
  • Tidy up tests and reduce size and runtime
  • This client should acquire a lock on the blog's folder before doing stuff to it more generally, especially during initialization etc...
  • what happens if user changes their handle? will pushing break?
    • I want them to be able to keep using their old one until someone else claims it, then I want 401 unauthorized, please reauthenticate with new username... but the remote path will be wrong?
  • Rate limit authentication route?

Dropbox client:

  • Does client.remove support the removal of folders? If not, make it so and add a test
  • Add a step to authentication flow which says: 'there is already a folder called 'Your blog title' in your Dropbox, would you like to use that?' then overwrite the files inside. This prevents the proliferation of confusing 'Your blog title (1)' when you re-authenticate.
  • Add a progress bar to the dashboard when writing existing files to Dropbox. It takes a while and confuses people.
  • Adding an additional blog to existing app folder under constant webhooks failed. New blog had correct folder but old blog still used root. I guess we need to acquire a lock on ALL blogs interacting with that dropbox account.
  • Extend sync lock during long syncs
  • Write test to simulate process dying and restarting mid-pull. Does the client recover?
  • Write tests for a series of random dropbox client operations (pull, add, push, move, reset, delete) that can be seeded and reliably re-run in the case of failure.
  • Look into getAccessTokenFromCode on DBSDK repo to avoid the mess in get_account.js https://github.com/dropbox/dropbox-sdk-js/issues/64
  • Gracefuly retry wrapper around Dropbox
  • Can we write to a folder_id instead of a path? It would be nice to be able to move the blog's folder even when writing the initial files to it, for example...
  • This should be simple once we copy the exisiting state of the blog folder across. But right now it doesn't really do much. It resets the local server folder. Then resyncs.
  • Update to latest version of Dropbox client.
  • Make the folder in Dropbox rename automatically when the user changes the username for one of their multiple blogs?

Consider supporting Open Graph

Add support for entry property with escaped double quotes, tell Jay

NGINX

  • Improve error pages
  • Recompile nginx with neccessary dependencies for auto-ssl instead of openresty?
  • Install nginx fail2ban & http2

Support linking to another blog post by its file path

Removing Date metadata from a post should reset its date to the file's creation date

  • Currently nothing changes.

Add a file dependency / dependents list to each entry then use this to rebuild dependent entries when, for example, a public image is updated.

Add support for comments via webmentions like Disqus and tell Amit

Thumbnail generator

  • Improve transformer so it checks a file's MTIME against a stored value before rehashing the file
  • Generate thumbnails for GIFs / SVG thum
  • Prioritize faces
  • Aim to generate distinct thumbnails across the blog
  • Try to crop out ruined borders. E.g. when making a square crop of a rectangular image with a border, crop into the image as well to remove the border-on-three-sides effect
  • Extract color palette too for the image
  • Run quickly first time, then run in the background to pick the best thumbnail
  • Offer imgix style API for embedding thumbnails

Migrate code from require('mime') to require('mime-types') since it doesn't use a global default type. Remove the mime node module.

Migrate code from require('../../../') to shortcuts in node_modules

Remove the dirToModule code and hard link the require references.

Use \<select> optgroup on timezone select dropdown to subdivide zones by current time, and steal the presentation format used by basecamp.

Move to pretty IDs for everything

Handle queries properly https://mail.google.com/mail/u/0/?zx=tqp989l7y4yi#inbox/15b575fbc8d80ad1

Giphy url support

Catch rename failed to find a match for scrapboox/patch_bunny_slippers.jpg -> /patch_bunny_slippers.png

Indicate that some posts' permalink will not change (if metadata) on the dashboard when setting the blog's permalink format. Tell Chet.

Add filtering by date to 404 log and tell this person

Daily update email

  • Move generator from scripts to app folder such that the server no longer depends on anything in /scripts.
  • Allow configurable timezone for when I travel?

If entries share publish date, sort them by blot creation date

Enable hyphenation again then tell rodericus

Add password protection for blogs then tell Ed, this person, this person, Modomiro and Roy's friend Tim.

Add option to enable hard line breaks

Move all unit tests which run on server start (the helper folder is littered with these, CMD+F for 'require('assert') into CI tests.

Incorporate typographic features from textile? http://redcloth.org/textile/phrase-modifiers/

Queue scheduled entries in redis somehow to make each server less stateful

Noindex blog search results pages

Re-enable CSP on blot site in a way that works in Safari

Expose list of rendering errors to callback

Push archives feature https://mail.google.com/mail/u/0/#inbox/14fb1a48c08fe9be

Make drafts preview file identical (construct iframe based on window.location.href) and use copyref?

Plugins:

  • Implement custom CSS for syntax highlight plugin
  • Fix image caption plugin to be semantic using
  • Ensure Youtube plugin still functions if apis fails
  • Prevent image zoom plugin from zooming emojies
  • Add soundcloud embeds then tell Jonas, Nashp, and Anders

Add URL rewrite feature, e.g. rewrite /randomColor to /public/randomColor

Menu needs concurrency or atomic operations (so we can build posts in parallel)

Investigate atompub support for Marsedit and tell Chet

Move from preview files -> webloc / .url files? Everything requires an internet connection

Consider adding date format localization with Moment

Add an embed plugin https://github.com/ritz078/embed.js

Look into how Jekyll does data files and possibly support?

Add .lhs support and tell Roy

Internationalize i8n and tell Christian about Portuguese

Add support for github style checkboxes and tell Christian

Add a cool bookmarklet which drafts a post a la this demo

Consider allowing users to buy domains on Blot through DNS simple