Tag Archives: yahoo pipes

Using PostRank: 2 Minute Yahoo Pipes Demo

Yahoo Pipes can also be used with other services, like PostRank, for example. PostRank, originally called AideRSS, is a service that rates the posts on any blog by popularity using comments, links, bookmarks, tweets, and other measurements to give each post a rank from 1 – 10. Luckily for us, PostRank conveniently stores the rank right in the RSS feed allowing us to access it from Yahoo Pipes. In our last Yahoo Pipes demo, I showed you how to Modify RSS Feeds to work better for your purposes. I recommend watching the 2 minute demo about modifying RSS feeds if you haven’t already, since we will use those concepts again in this pipe.

More Details

  • The Demo Pipe. A copy of the Using PostRank demo pipe – click “View Source” to see the modules.
  • PostRank. Using the 2 feeds that we’ve been using for most of these demos, ReadWriteWeb and GigaOM, we analyze each of them using PostRank, filter by the best posts, and copy the RSS feed for the output.
  • Fetch Feed. Fetches the elements from 2 PostRank feeds for ReadWriteWeb and GigaOM from the previous step.
  • Sort Module. Sort by PostRank in descending order to keep the posts with the highest rank at the top.
  • Loop module with String Builder Module. Loops through each element in the feed and builds a string with item.postrank:postrank: item.title. This string is assigned back into item.title.
  • Pipe Output. The final module in every Yahoo Pipe.

I’ve created many Yahoo Pipes, and most of them have been published on my Yahoo Pipes and RSS Hacks page where you can also learn more about my Yahoo Pipes Training courses.

Related Fast Wonder Blog posts

Modifying RSS Feeds: 2 Minute Yahoo Pipes Video Demo

While many people use Yahoo Pipes to filter RSS feeds, Pipes can also be used to modify RSS feeds to work better for your purposes. In this example, we will add the author name to the beginning of the title to make it easier to see the author without opening the item in your rss reader. I recommend watching the Introduction to Yahoo Pipes: 2 minute Yahoo Pipes Video Demo if you haven’t already, since we’re going use the basic pipe developed in that demo using fetch feed and sort modules, but without the filter module.

More Details

  • The Demo Pipe. A copy of the Modifying RSS Feeds demo pipe click “View Source” to see the modules.
  • Fetch Feed. Fetches the elements from 2 feeds: ReadWriteWeb and GigaOM.
  • Sort Module. Sort by date in descending order to make sure things are sorted in a logical manner.
  • Loop module with String Builder Module. Loops through each element in the feed and builds a string with item.author: item.title. This string is assigned back into item.title.
  • Pipe Output. The final module in every Yahoo Pipe.

I’ve created many Yahoo Pipes, and most of them have been published on my Yahoo Pipes and RSS Hacks page where you can also learn more about my Yahoo Pipes Training courses.

Related Fast Wonder Blog posts

Portland Data Plumbing User Group: Discuss RSS, Yahoo Pipes, and More!

I’ve decided to resurrect the Portland Data Plumbing Group to give us a time and place to talk about RSS feed hacking, Yahoo Pipes, Dapper, and other related technologies.

We’ll be having these meetings on the 2nd Tuesday of every month at 6pm (location TBD). The first meeting will be on:
Tuesday, January 13th
6:00pm – 7:30pm
Location TBD
Please RSVP on Upcoming if you plan to attend.

The agenda for the first meeting:

  • Intros
  • Round table discussion: each person gets 3-5 min to talk about the coolest thing they’ve done to manipulate an RSS feed.
  • Talk about ideas for future agendas.

If you want to be notified of future meetings, you should subscribe to the Portland Data Plumbing Google Group. A huge thanks to Justin for starting this group and for encouraging me to schedule a new meeting!

Related Fast Wonder Blog posts

CSV File Inputs: 2 Minute Yahoo Pipes Video Demo

This video shows how to get input from a list of items in a CSV file, and it introduces the loop module. A CSV file is a great choice when you want to fetch a bunch of feeds and change them frequently without having to update your pipe. If you haven’t already watched the 2 Minute Yahoo Pipes Introductory Demo, I strongly suggest that you watch it. This demo builds on the basic structure developed in the introductory demo. The CSV file I’m using also contains the same feeds from ReadWriteWeb and GigaOM that we used in the original demo plus a few others.

More Details

  • The Demo Pipe. A copy of the CSV File Input in Yahoo Pipes Demo click “View Source” to see the modules.
  • Fetch CSV Module. Enter the URL of the CSV file (make sure that it already exists in a publicly accessible location) along with information about column names and separation characters as needed.
  • Loop module with Fetch Feed. Loops through each element in the CSV file and fetches the feed associated with the item.
  • Filter Module. Filter by a couple of keywords.
  • Sort Module. Sort by date in descending order to make sure things are sorted in a logical manner.
  • Pipe Output. The final module in every Yahoo Pipe.

I’ve created many Yahoo Pipes, and most of them have been published on my Yahoo Pipes and RSS Hacks page where you can also learn more about my Yahoo Pipes Training courses.

Related Fast Wonder Blog posts

Writing for WebWorkerDaily and The Holidays

Many of you already noticed that I have started blogging on GigaOM’s WebWorkerDaily site. Thank you so much for all of the congratulations, well wishes, comments, and more. The plan is to post an article or two a week on a freelance basis. I even got a head start before I left, so I have a couple more posts in the WebWorkerDaily publish queue that should go out sometime next week.

My first post was about making productive use of my holiday time, and I am happy to say that I am off to a good start. I’m posting this from the Chicago airport (where my flight has been delayed), but at least I managed to edit and encode 2 more 2 minute Yahoo Pipes demos during my last flight, but you will have to wait to see them until I post the next one on December 29th.

I’ll also be mostly off the grid until December 27th. I’ll be in rural Ohio hanging out with family and playing scrabble, but my internet connection will be pretty spotty during the trip. They have dial up access (no DSL or cable on the farm), and even my EVDO access is painfully slow. In other words, you could be kind to my inbox and wait to email me until after the 27th *hint, hint*.

Have a great holiday season!

Using The Debugger: 2 Minute Yahoo Pipes Video Demo

The debugger serves a couple of functions in Yahoo Pipes. The first one is pretty obvious – debugging. It allows you to see exactly what is happening in each component of your Yahoo Pipe to help with the debugging process when something isn’t working quite right.

The debugger also serves a less obvious purpose. You can use it to learn more about the elements of the rss feeds that you are using as input. For most blogs, the rss feeds are fairly standard, but other services store all kinds of useful information in their rss feeds in addition to standard elements like link, title, and date. The debugger can help you find this additional information in the feed.

More Details

  • The Demo Pipe. A copy of the Yahoo Pipes Debugger Demo Pipe. Click “View Source” to see the modules.
  • Fetch Feed Module. Contains 1 feed from Shizzow, which contains a wealth of location information within the feed.
  • Filter Module. Filters posts with a certain keyword out of the feed to demonstrate the debugger.
  • Pipe Output. The final module in every Yahoo Pipe.
  • The demo also spends time using the debugger to explore various elements of the feed.

I’ve created many Yahoo Pipes, and most of them have been published on my Yahoo Pipes and RSS Hacks page where you can also learn more about my Yahoo Pipes Training courses.

Previous videos in the series:

User Input: 2 Minute Yahoo Pipes Video Demo

This video shows how to request a user input and use the keyword from the user as the filter in a Yahoo Pipe. If you haven’t already watched the 2 Minute Yahoo Pipes Introductory Demo, I strongly suggest that you watch it. The user input demo starts with the simple pipe created in the introductory demo and changes the filters from keywords hardcoded in the introductory pipe to the keyword from the user input.

Podcast Feed and iTunes

More Details

  • The Demo Pipe. A copy of the User Input Demo Pipe click “View Source” to see the modules.
  • Fetch Feed Module. Contains 2 feeds: ReadWriteWeb and GigaOM.
  • Text Input Module. Leave Name and Position as the defaults. Prompt: “enter a keyword” or other instructions for the user. Default and Debug: “apple” in this example. You can generally use the same term for default and debug, but make sure that you use a word commonly found in your feeds that will generate enough volume for testing and will generate default results for your users to view.
  • Filter Module. Filter by the keyword entered in the user input module by connecting the text input to the filter module as seen in the demo.
  • Sort Module. Sort by date in descending order to make sure things are sorted in a logical manner.
  • Pipe Output. The final module in every Yahoo Pipe.

I’ve created many Yahoo Pipes, and most of them have been published on my Yahoo Pipes and RSS Hacks page where you can also learn more about my Yahoo Pipes Training courses.

Related Fast Wonder Blog posts

Yahoo Pipes Video: 2 Minute Quick Vanity Feed Demo

If you haven’t already watched my 2 Minute Yahoo Pipes Introductory Demo, you might want to back up and start by watching it. This quick vanity feed demo builds on the concepts learned in the introduction with a practical example of how to create a quick and dirty vanity feed using Yahoo Pipes. Let me start by saying that this is a quick and easy way to create a vanity feed, but it isn’t the most elegant solution, since it has limited configuration options. However, that would be a much longer demo, and I wanted to have something that you can get started with quickly.

For anyone unfamiliar with the term, a vanity feed is where you search for mentions of your name, your company’s name, your products, your website and other mentions related to what people are saying about you online. In this example, we are using Gartner Research and assuming that the person building this pipe works at Gartner and wants to better understand what people are saying about the company online.

More Details

  • The Demo Pipe. A copy of the Quick Vanity Feed Demo pipe.
  • Example. We are using Gartner Research as our example company throughout this demo.
  • Fetch Feed Module. Contains 3 preconfigured searches using various sites. You can enter your search on any search engine that allows RSS feed output. Grab the RSS feed from your search and place it in the Fetch Feed module.
  • Unique Module. Use this to prevent duplicate results when multiple search engines return the same articles by filtering on item.link.
  • Filter Module. Filter out any unwanted results based on item links, keywords, or any other criteria. After watching your feed for a few days, you will start to see things you want to filter out even if you can’t think of any now.
  • Sort Module. Sort by date in descending order to make sure things are sorted in a logical manner.
  • Pipe Output. The final module in every Yahoo Pipe.

I’ve created many Yahoo Pipes, and most of them have been published on my Yahoo Pipes and RSS Hacks page where you can also learn more about my Yahoo Pipes Training courses.

Related Fast Wonder Blog posts

Yahoo Pipes for Social Media Monitoring and Business Benefit

Many large companies can afford to spring for expensive software packages that monitor what people are saying about your company, industry, and competition online; however, for those of us looking for an inexpensive solution, Yahoo Pipes can be an important tool.

After I published the 2 minute Yahoo Pipes demo on Monday, I realized that I have done many posts about Yahoo Pipes without ever writing about why people should care about the technology and how it can used. I decided it was time to devote a post to explaining how people can use Yahoo Pipes and get actual business benefits.

Using Yahoo Pipes can help you understand what people are saying about you, your industry, your competitors and more through smart filtering of blogs, news sources, Twitter, and other online sites. Your customers are talking about you and your competitors are revealing information that you want to know online. Can you find it quickly and efficiently now?

A few business benefits from using Yahoo Pipes:

  • Become more responsive to your customers by knowing when and where people are talking about your company and products on blogs and Twitter. Find and respond more quickly and efficiently.
  • Use what people are saying about your company and your products to improve your products / services, marketing messages, web content, documentation and other communications.
  • Get insight into your competitors.
  • Keep up with important information about your industry by focusing on keyword filtering to find the most relevant content for your situation.
  • Monitoring dashboards will help you disseminate the information from Yahoo Pipes throughout the rest of your organization.

While I think that monitoring is always important, I usually emphasize it when I am working on blogging strategies with clients. Knowing what people say about your organization, your industry, and your competition is an important element of a blogging strategy. All of the information found via Yahoo Pipes for the purposes above can then be used to generate ideas for blog posts or other communications.

What business benefits do you get from Yahoo Pipes?

Related Fast Wonder Blog posts

Yahoo Pipes Training: A 2 Minute Yahoo Pipes Demo

If you have been wanting to create Yahoo Pipes, but weren’t quite sure where to start when faced with the blank page on a new Yahoo Pipe, I created a very simple demo to get you started. This Yahoo Pipes demo will help you get started with Yahoo Pipes and show you what you need to know to create a basic Pipe. We use filtering for this example, since Yahoo Pipes is great at taking feeds and filtering to display only the posts that match (or exclude) certain keywords. The demo covers taking multiple feeds as inputs, filtering on keywords, sorting, and using the debugger to analyze the elements of your source feeds and your output. After watching this demo, you should be able to create a basic Yahoo Pipe and use it to filter to include or exclude items that match certain keywords.

Yahoo Pipes Training

I also wanted to take this opportunity to announce that I will begin conducting Yahoo Pipes training for organizations. These 2 hour classes will cover the basics of building Yahoo Pipes and provide some custom content if needed to help meet the specific needs of your organization.

More Details

You can view a copy of the 2 Minute Demo Pipe Source.

Modules Used:

  • Fetch Feed. Enter your source feeds here. These are the feeds that have the information you want to filter.
  • Filter. Filter the source feeds to include only posts that match certain keywords.
  • Sort. Sort by date (descending) to make sure that the output from your various source feeds appears in sorted order.
  • Pipe Output. The final module in every Yahoo Pipe.

Related Fast Wonder Blog posts