22 Jan 2009 18:57
TAGS: dev php python wikidot xmlrpc
A few days ago I started working on Wikidot API. The API will be a standardized way to access the Wikidot.com service in a programmable way (i.e. not using a browser) to retrieve, create and update information stored on Wikidot, including site browsing, page editing and commenting.
In simple words this will allow people to write applications that connect to Wikidot.com and perform some actions for the user that runs the application.
Technically, the Wikidot.com API is an XML-RPC service exporting methods from a few especially designed classes.
To connect to an XML-RPC service, you must know its endpoint, which is a regular URL (http:// or https://) address. We decided to use HTTPS to secure the channel from the very start.
The operations we are going to support are:
Browse
- site.categories
- site.pages
- page.get
Above ones are already implemented. Using the API calls you get retrieve almost all data you stored on the Wikidot.com sites!
Modify
- page.save
This will be the basic method to update the content on your site. We plan several other methods, but this is the one that is the most important.
Comments
- page.comments
- page.comment
They will be used to get and post comments on a given page. Using reply_to parameter, there is a possibility to reply to a particular comment.
Forum
- forum.groups
- forum.categories
- forum.threads
- forum.post
This bunch of methods are going to give you full access to the forums you have started on Wikidot.
How to use the API
We haven't yet enabled the API access to the main Wikidot.com server, but testing the API with Python XML-RPC library is as easy as this:
>>> from xmlrpclib import ServerProxy >>> s = ServerProxy('SOME-URL') >>> s.system.listMethods() ['system.listMethods', 'system.methodHelp', 'system.methodSignature', 'system.multicall', 'site.pages', 'site.categories', 'page.get'] >>> print s.system.methodHelp('site.pages') Get pages from a site Argument array keys: site: site to get pages from category: category to get pages from (optional) >>> s.site.categories({'site': 'gamemaker'}) ['project', 'rpg', '_default', 'action', 'admin', 'badge', 'beginner', 'contests', 'error', 'event', 'example', 'forum', 'gamemaker', 'gml', 'gmlcode', 'gmupload', 'help', 'ide', 'include', 'mamber', 'member', 'nav', 'portal', 'resource', 'search', 'system', 'talk', 'template', 'tutorial', 'video-tutorial', 'wiki', 'challenge', 'howto', 'recent-changes', 'scratch-pad', 'helpdesk', 'helprequest', 'default', 'testimonial', 'testimonials'] >>> [p['name'] for p in s.site.pages({'site': 'gamemaker', 'category': 'badge'})] ['cool', 'flux', 'c-team', 'gml', 'member', 'madman', 'not-a-noob', 'f-madman', 'start', 'break-it'] >>> print s.page.get({'site': 'gamemaker', 'page': 'badge:cool'})['source'] [[table style="width:98%;margin-right:auto;margin-left:auto;margin-bottom:1%;"]][[row]][[cell style="width:360px;"]] [[div class="error-block"]] Included page "include:cool-badge" does not exist ([/include:cool-badge/edit/true create it now]) [[/div]] The Cool Badge is given to people who make something really cool. [[/cell]] [[cell style="vertical-align:top;border:1px solid #ddd;padding:1%;"]] +++ Display Code [[table class="code"]][[row]][[cell]] @@[[include include:cool-badge member=member name]]@@ [[/cell]][[/row]][[/table]] +++ Tag {{cool-badge}} [[/cell]][[/row]][[/table]] [[table style="border:1px solid #ddd;padding:1%;margin-right:auto;margin-left:auto;margin-bottom:1%;width:98%;"]][[row]][[cell]] ++ Earn It * Program something really cool using gml * Make a really cool game +++ Tips * Make sure you post your examples and games on the [[[forum:start|forum]]]. Otherwise no one can see it and nominate you for the cool badge. [[/cell]][[/row]][[/table]] [[table style="border:1px solid #ddd;padding:1%;margin-right:auto;margin-left:auto; width:98%;"]][[row]][[cell]] ++ Members Who Have Earned the Cool Badge [[module ListPages category="member" order="titleAsc" tag="cool-badge" perPage="100" separate="false"]] * %%linked_title%% [[/module]] [[/cell]][[/row]][[/table]] >>>
A few words of explanation:
- first we import ServerProxy class from XML-RPC library,
- then we construct the ServerProxy object s supplying the endpoint URL (SOME-URL in this case, as we don't have yet decided what the URL is going to be)
- we can see a list of methods by calling system.listMethods on the ServerProxy object
- we get a help message for a method by calling system.methodHelp
- then we get categories of site gamemaker (yeah, it's a part of the wikicomplete.info)
- then we call site.pages method (specifying site and category parameters), but instead of displaying the whole list of structures that describe pages, we only display their names
- calling page.get returns an array with the information about a page, including:
- wiki source, array key: source
- generated HTML, array key: html
- array with various meta-data, array key: meta
- we call page.get passing as the argument array that specifies site and page name, get the page object, but displays only what's stored under the source array key
As you see playing with this is really easy as is browsing the available methods and using them.
Why XML-RPC
We've chosen this protocol because it is an easy way to develop both server and client in almost any programming language. Also it gives some flexibility in passed arguments and return values.
We use struct XML-RPC type as the argument and return value type, which is mapped to associative array or dictionary in client (and server) libraries. Each API method gets a bunch of required and optional parameters, that are basically values stored in the struct passed to API methods.
For example site.pages gets a struct with the following keys:
- site (site name to get pages from) — required
- category (category to get pages from) — optional
This means, you have to create an associative array (when using PHP) or a dictionary (using Python) and pass it as the method argument:
# PHP
$pages = $server->site->pages(array("site" => "my-site", "category" => "my-category"));
# Python pages = server.site.pages({"site": "my-site", "category": "my-category"})
Using other programming languages, you'll end with something similar. You can almost always create the array/dictionary in-place, so having this convention is not a big deal.
Applications
I'm working on a filesystem based access to Wikidot site (using FUSE and Python).
We plan having a Wikidot application for iPhone.
A save-it-directly-on-wikidot plugin would be a nice thing for various text editors (and probably other applications).
And probably there are billions of other ways to use this API we're not even aware of. If you have any, feel free to leave a comment.
I been thinking about this for a while, and would try my hand at it myself if I had a Mac! ;-) Far too over-priced for me, especially considering the development software for iPhone/iPod Touch costs an additional $100+.
Wikidot API has come a long way since you posted this :) Thank you for all of the work you're doing on this!
~ Leiger - Wikidot Community Admin - Volunteer
Wikidot: Official Documentation | Wikidot Discord server | NEW: Wikiroo, backup tool (in development)
Image not working? :S
~ Leiger - Wikidot Community Admin - Volunteer
Wikidot: Official Documentation | Wikidot Discord server | NEW: Wikiroo, backup tool (in development)
Post preview:
Close preview