Codelabs Site

A site for hosting codelabs content.

Prerequisites

The project requires the following major dependencies:

• Go language
• Node.js v10+ and npm
• gsutil
• claat

With Node installed, run npm install in the root of the site (this folder):

$ npm install

(Optional) npm installs binstubs at ./node_modules/.bin/. When running tasks like gulp, you may want to add ./node_modules/.bin/ to your $PATH for convenience:

$ export PATH="./node_modules/.bin/:$PATH"

This does pose a mild security risk, so please do so at your own risk.

Development

Serve

To serve the site in dev mode, run gulp serve, passing a path to a directory with the codelabs content as an argument. This will compile all the views and codelabs into the build/ directory and start a web server to serve that content.

$ gulp serve

The output will include the address where the server is running (http://localhost:8000 by default).

You can also serve the completely compiled and minified (prod) version with the serve:dist command. Always run this before publishing, as it will show you an replica of what will appear on staging/production.

$ gulp serve:dist

Views

Views are themed/styled collections of codelabs, served from the same url. Codelab tags are used for selecting codelabs into views. View definitions are stored in /app/views directory. Views commonly correspond to events (e.g. NEXT 2018) or abstract themes (e.g. Windows), but we refer to them generically as "views" internally.

Add a new view

To add a new view (e.g. to serve codelabs for a particular event):

1. Create a new folder in app/views, which will be the "view id". As the view id will appear in the URL, the name should be sluggified, meaning all lowercase with special characters replaced with dashes.

   // General example
   My Codelab -> my-codelab
   
   // Always substitute file extensions, otherwise the browser will get confused
   Learn underscore.js -> learn-underscore-js
   
   // Keep other URL-friendly characters when the context warrants
   Tracking with utm_source -> tracking-with-utm_source
   

2. Add a new file named view.json inside this folder. Here is a template view.json:

   // app/views/my-event/view.json
   {
     // Required: page and view title.
     "title": "My Event",
   
     // Required: Text description of the event. This will appear in the view
     // landing page.
     "description": "",
   
     // Required: list of string tags by which to include codelabs. Tags are
     // specified in the codelab by the codelab author.
     "tags": [],
   
     // Optional: list of string categories by which to include codelabs.
     // Categories are specified in the codelab by the codelab author.
     "categories": [],
   
     // Optional: name of a custom stylesheet to include. See also: point below
     // about custom styles.
     "customStyle": "style.css",
   
     // Optional: list of regular expressions to exclude particular codelabs.
     "exclude": [],
   
     // Optional: URL to a custom logo for the codelab. If provided, this logo
     // must be placed in app/views/<view-id>/ and referenced as such. For
     // example, if the event was named "my-event", this logo would exist at
     // app/views/my-event/my-event-logo.svg.
     //
     // Where possible, please use SVG logos. When SVG logos are not available,
     // please size images to be 125px high at 72 DPI.
     //
     // Minify images before uploading using a tool like ImageOptim.
     "logoUrl": "/my-event/my-event-logo.svg",
   
     // Optional: category level to use for iconography
     "catLevel": 0,
   
     // Optional: Method for sorting codelabs.
     "sort": "mainCategory",
   
     // Optional: List of codelab IDs that should be "pinned" at the start.
     // This is useful for "getting started" codelabs or when users should
     // complete codelabs in a specific order.
     "pins": [],
   
     // Optional: custom google analytics tracking code. By default, all
     // codelab views are tracked on the main codelab analytics.
     "ga": "",
   
     // Optional: If true, do not include this view in the list of views on
     // the home page. It will still be accessible via the direct URL.
     "hidden": false,
   }

3. (Optional) Add a file named style.css inside the view folder. If provided, this file will be included in the HTML, allowing for custom styles.

   This file is not included in the main assets bundle, so there will be a performance decrease as the browser needs to load additional styles. Furthermore, if the codelab schema were to change, your custom styles may be broken. Please check with the codelabs team to see if your style changes make more sense to upstream across all views.

4. (Optional) Add a file named index.html inside the view folder. This allows you to fully customize the view, but comes at the expense of duplication. Please use this sparingly and check with the core team before making drastic changes.

5. Execute the serve command as described above to see the view.

Build and serve a single view (deprecated)

The build is very fast, so you should not need to filter by a specific view. Instead, build all views and then visit the appropriate URL. If you still wish to build a single set of views, you can do so with the --views-filter parameter:

$ gulp serve --views-filter='^event-*'

Note this filter takes a regular expression. By default, all views are built.

Deployment

Once you build, serve, and verify your labs, you're on your own for publishing the artifacts. There are many ways to publish a static web site and we won't try to cover them all, however, we have included support for deploying your landing pages and codelabs to Google Cloud Storage (GCS).

Setup for GCS Support

Set environment variables like this (use your own names):

export STAGING_BUCKET=gs://mco-codelabs-staging
export PROD_BUCKET=gs://mco-codelabs-prod

Create staging and production buckets like this (use your own names):

18:42:32 site$ gsutil mb is $STAGING_BUCKET
Creating gs://mco-codelabs-staging/...
18:42:47 site$ gsutil mb $PROD_BUCKET
Creating gs://mco-codelabs-prod/...

Setup permissions and web access to your buckets

1. Make newly uploaded files world-readable and ensure user@ has owner permissions:

   $ gsutil defacl ch -g all:R -u [email protected]:O $STAGING_BUCKET $PROD_BUCKET
   $ gsutil iam ch allUsers:objectViewer $STAGING_BUCKET $PROD_BUCKET
   

   Add as many -u user@ as you require. This ensures the users will remain owners no matter who updates your bucket.

Deploy to staging

The following commands perform a "copy" operation, uploading all local files to the staging bucket. The local copy of a file will overwrite the staging copy of the same file. Staging files that do not exist in the local copy will be untouched. To perform a complete "sync" (make staging look exactly like the local copy), specify --delete-missing on the publish command.

1. Compile and minify the build:

   $ gulp dist
   

2. Deploy views to the staging bucket:

   $ gulp publish:staging:views --staging-bucket=$STAGING_BUCKET
   

3. Deploy codelabs to the staging bucket:

   $ gulp publish:staging:codelabs --staging-bucket=$STAGING_BUCKET
   

4. Visit the staging site (modify link to match your staging bucket name).

See #options for information on how to customize the staging bucket.

Deploy to prod

We do not deploy from local to production. Instead, we "promote" a staging build to production.

The following commands perform a "copy" operation, uploading all staging files to the prod bucket. The staging copy of a file will overwrite the prod copy of the same file. Prod files that do not exist in the staging bucket will be untouched. To perform a complete "sync" (make prod look exactly like staging), specify --delete-missing on the publish command.

1. Deploy views from the staging bucket to the production bucket:

   $ gulp publish:prod:views --staging-bucket=$STAGING_BUCKET --prod-bucket=$PROD_BUCKET
   

2. Deploy codelabs from the staging bucket to the production bucket:

   $ gulp publish:prod:codelabs --staging-bucket=$STAGING_BUCKET --prod-bucket=$PROD_BUCKET
   

3. Visit the production site (modify link to match your production bucket name).

See #options for information on how to customize the staging and prod bucket.

Deploy to custom bucket

This section describes the steps to create and deploy to a custom bucket. Replace gs://codelabs.mycompany.com with the name of your bucket. If you want to use GCS directly for serving, the bucket name must be a valid domain.

1. Create a new bucket:

   $ gsutil mb gs://codelabs.mycompany.com
   

2. Make newly uploaded files world-readable and ensure user@ has owner permissions:

   $ gsutil defacl ch -g all:R -u [email protected]:O gs://codelabs.mycompany.com
   $ gsutil iam ch allUsers:objectViewer gs://codelabs.mycompany.com
   

   Add as many -u user@ as you require. This ensures the users will remain owners no matter who updates your bucket.

3. Set the default main page suffix and not found page:

   $ gsutil web set -m index.html -e 404.html gs://codelabs.mycompany.com
   

   This option is only available on bucket names that are valid domains.

Follow the steps in deploy to staging with a custom --staging-bucket parameter. See #options for information.

Deploy single view or codelab

Where possible, build and publish the entire website. This will ensure all assets are up-to-date.

To build and publish a set of views to staging:

$ gulp dist --views-filter=^my-event
$ gulp publish:staging:views

To build and publish a set of codelabs to staging:

$ gulp dist --codelabs-filter=^my-codelab
$ gulp publish:staging:codelabs

Options

--base-url - base URL for serving canonical links. This should always include the protocol (http:// or https://) and NOT including a trailing slash. The default value is "https://codelabs.developers.google.com".

--codelabs-dir - absolute or relative path on disk where codelabs are stored. Any filters will be applied to these codelabs, and then the resulting selection is symlinked into the build folder. The default value is "." (the current directory).

--codelabs-filter - regular expression by which to filter codelabs IDs for inclusion. If a filter is not specified, all codelabs are included.

--codelabs-namespace - URL path where codelabs will be served in the web server. The default value is "/codelabs", meaning codelabs will be served at https://URL/codelabs.

--dry - Print out steps instead of actually taking them. This only applies to publish operations.

--delete-missing - Delete any files in the destination that are not present at the source (rsync-style behavior).

--prod-bucket - name of the GCS bucket to use for production resources. This is only used for publishing.

--staging-bucket - name of the GCS bucket to use for staging resources. This is only used for publishing.

--views-filter - regular expression by which to filter included views (events). If a filter is not specified, all views are included.

The following options are only relevant when invoking claat:

--codelabs-env - environment for which to build codelabs. The default value is "web".

--codelabs-format - format in which to build the codelabs. The default value is "html"

--codelab-source - Google Doc ID from which to build codelab. This can be specified multiple times to build from multiple sources.

Testing

To run the tests manually in a browser, execute the following:

$ gulp serve
$ open http://localhost:8000/app/js/all_tests.html

Help

For help documentation/usage of the Gulp tasks, run:

$ gulp -T

If gulp startup times are really slow, try removing node_modules/ or running

$ npm dedupe